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1.  Introduction 

The  numerical  eolation  of  the  initial  value  problem  for  a  system  of  N 

first  order  ordinary  differential  equations  is  considered: 

•  • 

y'  »  f (x,y)  a  <  x  <  b  (1.1) 

y(a)  given  .  (1.2) 

Modern  codes  based  on  step-by-step  methods  begin  with  y(a)  ■  yg  *t  xq  -  e 
and  step  from  a  to  b  successively  producing  approximations  yn  to  y(x,t) 
on  a  mesh  Xq  <  Xj  <  ***  <  x^  «  b.  At  the  step  from  the  code  selects  a 
step  size  hofi  so  that  tha  resulting  approximation  at  x^i  •  xn  +  h^  is  to 
satisfy  a  certain  accuracy  requirement. 

The  standard  assumption  about  f(x,y)  is  that  it  has  as  many  continuous 
derivatives  as  needed  and  that  It  satisfies  a  Llpschltz  condition, 

lf(x,u)  -  f(x,v)l  <  L  lu-vl  ,  (1.3) 

for  a  <  x  <  b  and  all  y.  This  guarantees  (1.1,  1.2)  has  a  unique  solution 
y(x).  The  "classical  situation"  la  that  L(b-a)  is  not  "large."  In  this 
situation  classical  numerical  methods  such  as  Runge-Rutta  and  Adams  are 
quite  satisfactory  with  one  major  exception  —  too  frequent  output  can  dras¬ 
tically  reduce  tha  step  size.  There  are  a  variety  of  other  reasons  why  the 
step  size  might  have  to  be  restricted,  but  in  the  classical  situation,  none 
can  ltad  to  a  severe  restriction  of  the  step  size. 


When  L(b-a)  Is  "large, "  Che  aaecer  is  quite  different.  In  Che  first 

place,  Che  class  of  aathematlcal  problems  must  be  restricted  In  order  for 

step-by-step  methods  to  have  a  chance  of  solving  the  problem  adequately. 

It  develops  that  In  some  extremely  Important  circumstances,  classical  methods 

suffer  a  variety  of  restrictions  on  the  step  slse  which  are  so  severe  that 

such  methods  are  impractical.  This  is  what  is  usually  termed  "stiffness." 

Many  authors  have  sought  a  definition  of  stiffness  involving  only  the 
mathematical  problem  (1.1,  1.2).  Unfortunately  the  situetion  is  far  more 
complex  than  that.  In  this  paper  we  shall  explore  those  factors  determining 
the  step  size  in  a  sequence  like  that  of  the  usual  treatment  of  Runge-Kutta 
methods.  All  the  seed*  of  step  size  restrictions  are  present  in  the  classical 
situation.  Wh  shall  see  how  a  large  Llpschltz  constant  affects  the  algorithms 
and  shall  describe  ways  to  circumvent  or  overcome  the  difficulties.  We  aim 
to  provide  some  feeling  as  to  the  kinds  of  problems  leading  to  severe  step 
size  restrictions  for  classical  methods  and  to  show  how  the  computational 
problem,  formula,  and  lmpleawntatlon  are  related  to  "stiffness.”  Some  remarks 
will  be  made  about  how  such  restrictions  can  be  recognized  automatically. 

2.  Mathematical  Problem 

Ue  are  Interested  in  approximating  a  vector  function  y(x)  which  satisfies 
(1.1)  as  an  identity  for  given  function  f(x,y)  and  Interval  fa.bj.  The 
solution  y(x)  is  to  have  the  specified  initial  value  y(a)  at  x  ■  a.  The 
assumption  tnat  f(x,y)  is  continuous  and  satisfies  a  Llpschltz  condition  (1.3) 
for  a  <  x  <  b  and  all  y  guarantees  that  the  equation  (1.1)  has  a  unique  solu¬ 
tion  for  any  given  initial  value  yQ  at  any  point  Xq  in  [a,b].  It  is  easy 
to  reduce  the  requirements  on  f  to  holding  only  in  a  neighborhood  of  the 
solution  y(x).  Although  this  reduction  is  of  great  theoretical  and  practical 


value,  we  do  not  want  to  complicate  matters  by  going  Into  details. 

One-step  methods  exemplify  step-by-step  methods.  They  have  the  form 

yn+1  "  7n  +  hn+l  *<*n.7nihtH-l>  •  f2*1) 

Having  reached  Xq,  such  methods  are  supplied  only  the  values  Xg,  yn,  hg+i, 
and  the  ability  to  evaluate  f.  It  Is  clear  that  the  best  one  can  hope  to  do 
Is  to  approximate  u(Xg+i)  where  u(x)  Is  the  "local  solution"  of  (1.1)  with 
Initial  value  yn: 

u'  -  f(x,u)  ,  u(Xg)  ■  yn  •  (2.2) 

Some  of  the  classical  methods  use  a  small  number  of  the  most  recent  previously 
computed  approximations,  but  the  situation  Is  not  really  any  different  for 
them. 

The  question  which  Immediately  arises  Is  how  well  does  u(x)  approximate 
y(x)  for  x  >  Xg.  This  Is  a  question  of  the  stability  of  the  solution  y(x).  A 
classical  result  states  that  if  u(x),  v(x)  are  two  solutions  of  (1.1),  then 

»u(x+A)  -  v(x+A)l  <  e^*lu(x)  -  v(x)  I  (2.3) 

where  L  Is  the  Llpschltz  constant  of  (1.3).  The  result  is  sharp  as  the 
single  equation  y'  •  Ly  shows. 

We  simply  cannot  solve  unstable  problems  in  practice  by  the  kinds  of 
methods  we  consider.  A  single  error  of  e  at  xn  moves  us  from  y(x)  to  the 
u(x)  of  (2.2).  If  u(x)  diverges  strongly  from  y(x),  the  error  of  e  Is  ampli¬ 
fied  accordingly.  Of  course  what  "too"  much  means  depends  on  the  accuracy 
desired  and  the  computing  budget.  In  the  classical  situation,  (2.3)  Implies 
that  y(x)  Is  reasonably  stable. 


A  large  Llpschlts  constant  tells  us  that  some  solutions  of  (1.1)  either 
diverge  or  converge  rapidly  in  a  relative  sense.  Suppose  equality  holds  in 
(1.3)  for  so*  u0»  v0  M*r  y(xo).  »(*)  he  the  loeel  solution  of  (1.1) 
with  u(xq)  ■  uo  and  similarly  define  v(x).  Further  let  6(x)  ■  u(x)  -  v(x). 
Then  (1.3)  states  that 

There  are  probleas  of  great  practical  iaportance  for  which  the  Llpschltz 
constant  is  "large."  Here  and  later  we  say  the  Llpachita  constant  is  large 
as  an  abbreviation  for  the  stateaent  that  (b-a)L  Is  large;  the  reader  should 
reaeaber  that  the  length  of  the  interval  is  also  laportant.  As  noted,  a 
problea  with  a  large  Llpschlts  constant  aay  be  unstable.  For  the  kinds  of 
nuaerlcal  methods  we  consider,  we  aust  assume  that  the  solution  is  stable. 

Zn  order  to  formulate  quantitative  results,  we  aust  suppleaent  the  Llpschlts 
condition  with  soae  other  condition  guaranteeing  stability. 

The  most  studied  class  of  probleas  with  large  Llpschlts  constants  consists 
of  linear  probleas  with  constant  Jacohians: 

y*  -  Jy  +  F(x)  .  (2.4) 

It  is  often  assuaed  for  convenience,  and  we  do  so,  that  J  has  a  complete  set 
of  eigenvectors  {v^>  and  associated  eigenvalues  {X^}.  The  general  solution 
can  then  be  written  in  terms  of  a  particular  solution  p(x)  as 

N 

y(x)  -  p(x)  +  23aivi,Xi^*”*^  •  (2*5) 

i-i 

This  class  is  so  slaple  that  aany  nuaerlcal  procedures  can  be  analysed  in 
considerable  detail  and  so  provides  insight  es  to  more  general  probleas. 


The  representation  (2.5)  makes  it  dear  that  stability  is  equivalent  to  the 
requirement  that  for  all  i,  either  Re(Xj)  <  0  or  if  Re(X^)  >  0,  then 
(b-a)Re(Xi)  is  not  large.  Notice  that  Ul  •  L  *  (X^(  for  all  i,  so  the 
presence  of  soma  Xj  with  (b-a)Re(Xj)  «  -1  Implies  a  large  Llpschitz  constant. 

It  is  often  suggested  that  the  general  problem  (1.1)  be  modelled  near 
a  point  Xq^Xq)  by  a  problem  of  the  form  (2.4): 

«*  "  *(*n.y<*n>)  +  fx(*n»y<*n>)  +  fy  (*n.y<*n>)  (*-y(*n>) 

where  fy  is  the  Jacobian  matrix  of  first  partial  derivatives  of  f.  This  is 
a  time-honored  tactic  of  applied  mathematics.  He  say  that  our  numerical 
methods  should  perform  well  on  problems  of  the  fora  (2.4)  end  that  we  hope 
the  linearization  stated  will  provide  a  useful  guide  for  more  general  problems. 
Recent  work  has  considered  f  which  satisfy 

<f(x(u)  -  f(x,v),  u— v>  <  iiu-vl2  (2.6) 

for  a  suitable  inner  product  <*,*>.  This  is  a  one-sided  Llpschitz  condition 
because  in  general 

-L hi-v I2  <  <f(x,u)  -  f(x,v),u-v>  <Llu-vl2  . 

The  new  thing  is  that  1  might  be  a  lot  less  than  L  and  even  negative.  By 
differentiating  D(x)  -  exp (-2 lx) lu(x)  -  v(x)l2,  one  can  show  that 

lu(x+-A)  -  v(x+A)  I  <  e*Alu(x)  -  v(x)  I  ,  (2.7) 

which  can  be  a  great  Improvement  over  (2.3). 

A  variant  is  to  consider  problems  of  the  form 


y*  -  Jy  +  g(x,y) 


(2.8) 


where  g  satisfies  e  Llpechitz  condition 


(g(x,u)  “  g(x,v)l  <  phi-vl  (2.9) 

end  p  ie  the  smallest  cone tent  such  thet 

<Jz ,z>  <  plz|2  ail  z 

for  the  constent  oetrlx  J.  The  quantity  p  -  p[J]  Is  celled  the  logerlthalc 
"norm”  of  J  end  it  aey  be  negative.  One  cen  then  prove 

fu(x+A)  -  v(x+A)l  <  e^P^luCx)  -  v(x)  I  . 

Notice  thet  this  cless  is  included  in  (2.6)  with  l  m  p  +  p.  This  dess  Is  a 
neturel  one  for  the  investlgetlon  of  several  hinds  of  methods  and,  as  we  shall 
see  later,  is  neturel  for  certain  practical  reasons  as  well. 

In  summary,  continuity  of  f  and  a  Llpschltz  condition  guarantee  existence 
and  uniqueness  of  the  solution  y(x)  of  (1*1,  1.2).  We  cannot  solve  (1.1,  1.2) 
in  practice  using  step-by-step  methods  if  y(x)  is  not  moderately  stable.  In 
the  classical  situation  of  (b-a)L  not  large,  the  Llpschltz  condition  alone 
guarantees  adequate  stability.  Otherwise  we  must  assume  stability,  or  supple¬ 
ment  the  Llpechitz  condition  with  other  hypotheses  about  the  problem  which 
guarantee  stability.  We  have  mentioned  three  such  subsets  of  Lipschltzlan 
problems  for  which  stability  can  be  demonstrated  even  when  the  Llpschltz  con¬ 
stant  is  large. 

A  qualitative  way  to  describe  the  problems  with  large  L  which  Interest  us 
is'  that  y(x)  is  stable  in  the  direction  of  Integration  and  some  solution  of 
(1.1)  approaches  y(x)  very  rapidly.  A  way  we  prefer  for  describing  the  latter 
condition  is  that  y(x)  is  very  unstable  in  the  opposite  direction.  Notice 
that  the  stability  result  (2.3)  shows  that  in  the  classical  situation,  y(x) 


-7 


is  stable  in  both  directions.  Tor  stiffness  to  occur,  there  must  be  a  strong 
directional  effect. 


3.  Classical  Formulas 

The  Adams  family  of  formulas  for  approximating  the  solution  of  (1.1) 
arises  from  an  equivalent  integral  form: 


y<*n+l>  “  F(*n>  + 


y'(t)dt 


(3.1) 


Approximations  to  y'(t)  arise  naturally  from  approximations  yj  to  y(x^)  by 


y'(xi)  -  f(xi,y(x1))  -  f(x1,y1)  . 


(3.2) 


The  Adams  formulas  approximate  y'(t)  in  (3.1)  by  interpolating  values 
f i  »  f(Xi,yi)  previously  computed.  Thus  an  Adams-Bashforth  formula  of  order 
p  forms  the  (unique)  polynomial  P(x)  of  degree  p  interpolating  to  fn_i  for 
i  •  0,lt***,p  and  then  defines 


r*n+l 

P(t)dt  . 


This  explicit  formula  is  defined  for  any  set  of  mesh  points  but  simplifies 
in  the  case  of  constant  step  size  h  to  a  formula  of  the  form 


yn+i  ■  yn  +  h  2®ifn-i  • 

i-0 


The  simplest  example  is  the  (forward)  Euler  method 


yn+1  ■  yn  +  h*n 


(3.3) 


The  Adams^loulton  formula  on  p  points  interpolates  to  the  unknown  value 


*(xn+l*yitfl)» 

P(xn+l-i)  "  fn+l-i  »  i  "  °*1****»P  • 

This  formula  defines  Tnfi  implicitly.  For  constant  step  size  it  has  the  form 

P 

yttfi  "  7n  +  hPof<xtH*ityff»-i)  +  b  y^AffH-i-i  • 

i-i 

The  simplest  example  is  the  backward  Euler  method 

Tn+1  *  yn  +  W(*n+l»yrH-l>  • 

The  backward  differentiation  formulas  (BDF)  have  a  similar  origin.  Now 
the  polynomial  P(x)  Interpolates  to  solution  values: 


P(xn+l-i>  "  *n+l-i  1  "  » 

and  the  differential,  rather  than  the  Integral,  form  of  the  equation  is  used: 

P’(*n+1^  “  ^(xn+l»p^xn+l))  "  ^(xTrH»yiH-l^  • 

For  constant  step  size  h  this  results  in  a  formula  of  the  form 

P 

ynfl  ‘  hTOf(*n+l»yn+l>  +  2  WtH-l-i  • 

i-1 

The  backward  Euler  formula  happens  to  be  one  of  the  BDF. 

These  formulas  are  representative  of  classical  methods  using  previously 
computed  solution  values.  In  the  case  of  implicit  methods  such  as  Adams-Moulton 
and  BDF  there  are  the  immediate  questions  as  to  whether  they  are  well-defined, 
and  how  they  are  to  be  evaluated  in  practice.  In  the  classical  use  this  is 


always  done  by  simple  iteration.  A  predicted  value  y*^  Is  first  formed 
with  an  explicit  formula.  The  iteration  method  will  be  exemplified  for  the 
backward  Euler  method: 

"  ya  +  hf(xn+i»yS})  «-o,i,*-*  .  o.4> 

It  is  easy  to  see  that  a  sufficient  condition  for  convergence  is  that 

hL  <  1. 


It  is  necessary  that 

hP  (fy(*trH»yn+l))  <  1 

where  fy  is  the  Jacobian  matrix  of  f  and  p(M)  is  the  spectral  radius  of  the 
matrix  H.  The  sufficient  condition  guarantees  contraction  in  the  norm  being 
used.  It  is  virtually  the  necessary  condition  in  practice  because  only  a 
very  few  iterations  are  allowed  in  the  codes  and  convergence  must  be  observed. 

There  is  a  variation  on  the  use  of  the  Adams -Moulton  methods  which  does 
a  fixed  number  of  iterations ,  a  common  choice  being  one.  An  example  is  the 
use  of  the  Euler  method  as  predictor  and  one  "correction”  with  the  backward 
Euler  method: 

j4+i  "  yn  +  hf<*n.yn>  » 

7n+l  "  ^  +  hf(*n+l*4+})  ’ 

This  variation  results  in  explicit  methods  which  behave  similarly,  but  by  no 
means  identically,  to  the  implicit  methods. 

The  one-step  methods  were  mentioned  earlier.  The  most  important  classical 


examples  are  the  Runge-Kutta  methods.  An  s-stage  method  has  the  form 
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yn+i  ■  yn  +  2ciki 
i-i 

where 

+  ».♦•>  I>1*)  • 

J-l 

The  constants  a*  satisfy 

s 

Si  -  btJ  i-l."\*  , 

J-l 

and  the  constants  b^j,  cj  define  the  net hod.  If  bjj  -  0  for  ell  J  >  1,  the 

are  evaluated  explicitly  In  the  order  1  ■  1, * "  ,s  and  the  aethod  Is  explicit. 
Otherwise  It  la  lapllclt.  The  Euler  aethod  (3.3)  Is  also  an  exaaple  of  an 
explicit  Runge-Kutta  formula  and  the  backward  Euler  aethod  Is  an  exaaple  of 
an  lapllclt  Runge-Eutta  formula.  In  the  classical  use  of  lapllclt  Runge-Kutta 
formulas,  they  are  also  evaluated  by  slaple  Iteration: 


kf”  -  f(s  +  W,.  y.  *  h  .-0,1,-  . 

J-l 

A  sufficient  condition  for  convergence  Is  hyL  <  1,  where  y  Is  s  constant 
depending  only  on  the  formula. 

The  classical  formulas,  as  exemplified  above,  are  all  explicit,  or  are 
evaluated  by  simple  Iteration.  In  every  case,  simple  Iteration  converges 
If  the  step  sise  satisfies  hL  <  x  for  a  constant  x  which  depends  only  on  the 
aethod  and  which  Is  not  particularly  small.  In  the  classical  situation 
hL  <  (b-a)L  and  L  Is  not  large,  hence  simple  Iteration  does  not  pose  s  severe 


restriction  on  the  step  size.  Obviously  the  sltuetlon  Is  quite  different  If 
the  Llpschltz  constant  Is  large.  It  Is  Important  to  appreciate  that  a  severe 
restriction  on  the  step  slse  arises  only  when  hL  »  1.  Thus  the  problem 
must  have  a  large  Llpschlts  constant,  the  solution  must  be  stable,  and  the 
solution  must  be  easy  to  approximate  In  the  sense  that  the  desired  accuracy  can 
be  achieved  with  a  step  size  h  such  that  hL  »  1.  Later  we  shall  explore  circum¬ 
stances  leading  to  this  situation.  The  restriction  Is  one  manifestation  of  the 
complex  of  phenomena  called  stiffness.  The  difficulty  of  defining  stiffness 
Is  evident  here.  For  some  kinds  of  methods  there  is  no  step  size  restriction 
of  this  kind  at  all.  The  ones  that  do  have  such  restrictions  suffer  In  vary¬ 
ing  degrees.  Clearly  stiffness  depends  on  the  method  as  well  as  the  problem. 

The  key  to  solving  problems  with  large  Llpschltz  constants  Is  to  resort 
to  a  more  powerful  Iteration  method  for  evaluating  implicit  formulas.  The 
only  popular  way  Is  to  linearize  the  algebraic  equations  by  the  simplified 
Newton's  method.  In  the  case  of  the  backward  Euler  method  this  Is 

yfti15  -  yn  +  h[f(*it+i*ySl)  +  -  yim))]  •  (*•*> 

Here  J  "  fy(xn+i,yn+i).  Newton's  method  does  not  use  a  fixed  matrix  J,  rather 
uses  fj  t°  calculate  y^+i^*  Generally  the  formation  of  approximate 

Jacoblans  Is  very  expensive.  For  example,  each  iteration  of  (3.4)  requires 
only  one  evaluation  of  f.  In  the  common  case  of  forming  J  by  differences  for 
a  system  of  N  equations,  N  evaluations  of  f  are  made  just  to  form  J.  For  this 
reason  It  Is  considered  impractical  to  use  Newton's  method  Itself.  In  (3.3) 
one  must  repeatedly  solve  linear  systems  with  matrix  I-hJ.  Simply  decomposing 
this  matrix  into  triangular  factors  Is  rather  expensive,  and  the  repeated  sub¬ 
stitution  processes  to  solve  for  the  *rc  *  cost  by  no  means  negligible. 


The  simplified  Newton  iteration  is  so  ouch  wore  expensive  than  simple 
iteration  that  It  can  be  worthwhile  only  if  the  step  size  must  be  severely 
restricted  to  get  convergence  with  simple  iteration*  Of  course  a  great  deal 
of  research  has  been,  and  is  being,  devoted  to  minimising  the  eoets  of  this 
iteration.  For  example,  the  s- stage  Runge-Kutta  process  involves  a  system 
of  sN  algebraic  equations  at  each  atap.  This  can  be  reduced  in  various 
ways  to  dealing  with  syatams  of  sise  N.  The  structure  of  the  Jacoblans  can 
be  used  to  reduce  the  costs  of  forming  these  matrices  and  of  solving  the 
resulting  linear  systems* 

An  important  cost-saving  device  is  to  use  an  approximate  Jacobian  J  for 
as  many  steps  as  possible.  Convergence  of  the  iteration  and  the  rate  of  con¬ 
vergence  depend  on  how  well  J  approximates  fy(*n+l»7n+l)  {or  the  various  Xq+i* 
As  long  as  convergence  is  adequate,  one  should  continue  to  use  J.  It  is  a 
fundamental  practical  assumption  that  the  Jacobian  is  roughly  constant  for 
distances  much  larger  than  1/L.  This  is  one  reason  why  the  class  of  problems 
of  (2.8)  la  particularly  significant  for  analysing  practical  computation. 

Codes  intended  for  stiff  problems  are  based  on  implicit  methods  for 
reasons  we  shall  examine  below.  Until  recently  the  simplified  Newton  itera¬ 
tion  was  used  exclusively  during  an  integration.  Whenever  hL  is  not  large, 
this  is  grossly  inefficient.  The  inefficiency  is  not  as  bad  as  it  might 
seem  at  first  because  efficient  reuse  of  an  approximate  Jacobian  reduces 
the  waste.  Still,  the  inefficiency  is  significant  when  solving  a  problem 
which,  e.g.,  does  not  have  a  large  Llpsehlts  constant.  Codes  intended  for 
non-stiff  problems  use  simple  iteration  exclusively  if  they  are  based  on 
implicit  methods.  This  is  grossly  inefficient  if  the  problem  has  a  large 
Llpsehlts  constant  and  its  solution  allows  a  seep  else  h  such  that  hL  »  1. 


Xt  it  worth  remarking  that  the  same  formula,  e.g.,  the  backward  Euler,  might 
be  ueed  in  both  kinds  of  code.  Recent  research  has  considered  how  to  recog** 
nize  when  simple  iteration  is  feasible  and  efficient.  There  has  been  con¬ 
siderable  success  at  recognizing  and  coping  automatically  with  this  manifesta¬ 
tion  of  stiffness* 

4.  Output 

So  far  we  have  considered  approximate  solutions  only  at  mesh  points. 

If  the  user  wants  results  at  specific  points,  the  code  will  have  to  reduce 
its  step  size  as  necessary  so  that  these  points  are  in  the  mesh.  A  more 
efficient  alternative  la  natural  with  the  Adams  formulas  and  the  BDF.  They 
are  based  on  polynomial  lnterpolants  which  can  simply  be  evaluated  et  the 
places  specified  by  the  user.  In  this  way  the  step  size  of  the  code  is  not 
affected  by  the  output  requirements.  (Actually  it  is  affected  weakly  in  the 
popular  codes  for  various  software  reasons.) 

One  might  not  think  that  output  could  severely  restrict  the  step  size, 
but  for  some  methods  it  certainly  can.  Runge-Kutta  methods  of  many  stages 
must  take  ‘’large"  steps  to  compensate  for  the  expense  of  a  step.  The  classical 
extrapolated  mid-point  rule  can  be  viewed  in  typical  implementations  as  a 
family  of  Runge-Kutta  methods  of  a  great  many  stages.  Obviously  the  methods 
described  for  problems  with  large  Llpschitz  constants  do  a  great  deal  of 
work  at  each  step.  This  pays  off  only  when  the  step  size  is  large.  The 
fact  that  the  BDF  are  not  impacted  by  output  is  one  reason  for  their  popu¬ 
larity.  Recent  research  has  considered  ways  to  “Interpolate,"  or  at  least 
to  weaken  the  effect  of  output  on  methods  which  produce  values  only  at  mesh 
points. 
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The  effects  of  output  depend  on  the  formula  and  how  It  la  implemented. 
Excessive  output  for  certain  methods  has  exactly  the  same  effect  as  what  is 
called  stiffness.  However,  it  la  easier  to  see  the  origin  of  the  difficulty 
and  thare  la  usually  not  a  severe  restriction  on  the  step  slse.  Furthermore, 
alternative  methods  not  seriously  affeetsd  by  output  have  been  widely  available. 
He  shall  refer  no  more  to  this  issue,  but  the  reader  should  keep  in  mind  that 
the  computational  problam  (which  includes  specification  of  output  points) 
may  determine  whether  the  step  slse  possible  is  severely  restricted  end  further 
that  this  depends  on  the  formula  and  how  it  is  Implemented. 

5.  Stability 

In  our  description  of  convergence  we  shall  restrict  our  attention  to 
one-step  methods,  mors  particularly  to  Hunga-Kutta  methods,  in  order  to  avoid 
technical  details  arising  from  use  of  previously  computed  solution  values. 
Suppose  the  integration  has  reached  (s^tyn)*  A  one-step  method  produces 

Fn+1  ’  Fn  +  hiH-l  *<*n»FniV-l>  • 


Let  us  define 


*n+l  -  7<*n>  ♦  *n+l*(*n.F<*n>SNrl-l)  » 

the  value  the  formula  would  produce  if  it  had  available  the  correct  solution 
value  at  Xq.  A  fundamental  decomposition  of  the  error  is 

y<*n+l>  ”  7n+l  "  (y<*n+l>  “  *n+l)  +  < *0+1-70+1 >•  (5-D 

The  difference  y(Xg+i)  -  Zg+i  in  (5.1)  is  the  local  truncation  error, 
lte,  which  measures  how  well  the  formula  approximates  the  behavior  of  the 
differential  equation.  Notice  that 


y(*o+l)  -  y(*n>  +  htrt-l  ®(*n»y(*n>ihiH-l)  +  lt€ 


The  difference  Xq+i  -  y^i  measures  the  eteblllty  of  the  formula.  We  need  to 
relate  it  to  y(*n)  -  yB  In  e  way  analogous  to  the  stability  results  for  the 
differential  equation  Itself. 

The  step  site  h^n  is  chosen  so  that 

Utel  <  h^  c  (5.2) 

for  e  tolerance  e  provided  by  the  user  of  the  code.  We  shall  see  how  this 
can  be  accomplished  in  the  next  section.  Let  h^n  end  h^x  be  the  smallest 
end  largest  step  sixes  allowed  by  (5.2)  for  any  x  in  [a,b]. 

It  is  easy  to  eetebllsh  the  stability  result  for  RungeHCutta  methods 

that 

***tH  "  Tn+1*  *  (l+hlH.1X)»y(xn)  “  y^l  (5*3) 

which  comes  directly  from  the  Llpschitx  continuity  of  the  function  «  : 

l«(x.u;h)  -  «(x,v;h)l  <  Xhi-vl  .  (5.d) 

These  reaults  hold  only  for  hL  <  c.  When  c  is  small,  X  ■  L  and  the  factor 
(l+tig+i^)  in  (5.3)  approximates  the  analogous  factor  exp(hn+]L)  of  the 
differential  equation. 

Combining  (5.2)  end  (5.3)  leads  to 

WsirH.)  “  y«fl>  <  (l+bnfi£)ly(xn)  -  yn<  ♦  t»„fi  e 

«  (l*HtaaxX)  *y(*n)  ”  Tn*  +  Nux  « 

which  then  Implies 

nexly(xk)  -  yk*  <  -y-  £exp  ^X(b-a)  j  -  lj  .  (5.5) 
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In  Che  classical  situation  the  stability  of  all  the  Runge-Kutta  methods 
Is  adequate  and  the  convergence  result  (5.5)  satisfactory.  Let  us  consider 
the  stability  of  the  formulas  when  L  is  large.  The  constraint  that  hL  be 
not  large  is  not  artificial  as  the  simplest  examples  show*  (It  is  also  not 
due  to  implicit  formulas  as  we  shall  see  in  a  moment.) 

In  section  2  we  discussed  the  stability  of  solutions  of 

y'  -  Jy  +  F(x)  (2.4) 

when  J  is  a  (constant)  matrix  with  a  linearly  Independent  set  of  eigenvectors. 
The  difference  of  two  solutions,  w  ■  u-v,  satisfies  w'  -  Jw.  The  (constant) 
change  of  variables  w  -  M6,  where  the  columns  of  M  are  the  eigenvectors  of  J, 
uncouples  the  equations  into  the  set 

6^(x)  -  X161(x)  i  •  1,**\N 

where  1*  Is  a  (possibly  complex)  eigenvalue  of  J.  It  Is  easy  to  verify  that 
the  same  scheme  works  for  the  Runge-Kutta  methods  with  the  result  that 

5i,n+l  *  R^hxi>6l,n 

where  6*fn  »  6^(xn).  Here  R(z)  Is  a  polynomial  for  explicit  Runge-Kutta 
methods  snd  Is  a  rational  function  for  implicit  methods. 

For  the  sake  of  simplicity  we  consider  the  case  of  Re(X^)  <  0  each  1  so 
that  fij(x)  is  non-increasing.  It  is  noteworthy  that  this  means  that  in  a  suit¬ 
able  norm, 

lu(x+A)  -  v(x+'A)l  <  lu(x)  -  v(x)t  .  (5.6) 

The  formula  preserves  this  stability  property  of  the  differential  equation 
only  if  |R(hX^) I  <  1  for  each  A*.  The  region  of  absolute  stability  S  of 
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the  method  Is  the  set  of  z  such  that  Re(z)  <  0  and  |R(z)l  <  1.  The  step  size 
h  oust  be  constrained  so  that  hXj  6  S  for  each  eigenvalue  of  J. 

All  the  explicit  Runge-Kutta  methods  have  finite  regions  of  absolute 
stability.  This  follows  because  |P(z)}  ♦  •  as  I z I  ♦  •  for  these  non-trlvlal 
polynomials.  Indeed,  all  the  classical  explicit  methods  have  finite  regions 
of  absolute  stability,  We  point  out  that  L  ■  I J I  >  so  that  in  the 
classical  situation  this  stability  constraint  on  h  is  not  severe,  as  follows 
already  from  the  general  result  for  Lipschltzlan  problems  (5.3).  Notice  that 
in  the  norm  of  (5.6),  if  the  formula  is  absolutely  stable  with  the  step  size 
h,  the  convergence  results  are  much  stronger  than  in  (5.5): 

•y(*nH>  "  ytH-1*  <  »y(*n>  ”  ?nl  +  hn+l  * 

<  •*•  <  (h1-H»2+“*+hlrt.1)  c 

using  y(a)  -  jq.  This  reflects  the  additional  information  available  about  the 
stability  of  the  differential  equation. 

Obviously,  even  to  solve  the  very  special  class  of  problems  (2.4)  with 
hL  »  1,  we  need  methods  with  infinite  stability  regions.  As  already  noted, 
we  must  resort  to  implicit  methods.  Very  stable  methods  exist,  e.g.,  the 
backward  Euler  method  has 

|R(z)J  -  j_L.|  <  1  all  Re(z)  <  0  , 

but  we  then  must  pay  the  price  of  implicitness  discussed  in  the  preceding 
section.  A  great  deal  of  effort  has  been  devoted  to  finding  formulas  with 
good  stability  properties  which  can  also  be  avaluatsd  relatively  cheaply. 

It  should  be  appreciated  that  the  formulas  in  common  use  do  not  have  ideal 
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stabillty  even  for  the  class  (2.4).  For  example,  all  the  popular  BDF  of 
orders  at  most  6  have  infinite  absolute  stability  regions.  Still,  some  are 
finite  for  eigenvalues  near  the  Imaginary  axis.  It  is  quite  easy,  for 
example,  to  write  down  a  problem  for  which  the  BDF  of  order  3  has  no  sta¬ 
bility  restriction,  but  the  one  of  order  4  does,  and  the  restriction  suffered 
is  just  as  severe  as  that  of  an  explicit  Runge-Kutta  formula.  Evidently  stiff¬ 
ness  depends  on  the  formula  as  well  as  the  problem. 

In  our  view  these  stability  constraints  arising  from  the  simple  class 
(2.4)  are  necessary  requirements  for  a  reasonable  numerical  procedure.  Of 
course  we  hope  that  the  behavior  for  (2.4)  is  indicative  of  the  behavior  of 
the  procedure  for  more  general  problems.  A  considerable  amount  of  practical 
experience  suggests  that  it  is  provided  that  one  is  a  little  cautious.  For 
example,  the  trapesoldal  rule  has  JR(s)|  <  1  for  all  t  with  Re(z)  <  0.  How¬ 
ever,  R(x)  ♦  -1  as  |s|  ♦  •  so  that  the  formula  Is  barely  stable  for  |hXjJ  »  1. 
One  expects,  and  sees,  slowly  dsaped  oscillations  in  the  numerical  solutions. 
Furthermore,  It  Is  not  difficult  to  write  down  problems  only  a  little  different 
from  those  of  (2.4)  for  which  this  rule  is  unstable. 

Naturally  stability  results  for  classes  broader  than  (2.4),  e.g.,  (2.6) 
or  (2.8),  are  of  great  Interest.  He  mention  one  such  result.  Suppose  we 
consider  the  class  (2.6)  with  I  ■  0  so  that  no  two  solution  curves  spread 
apart.  A  Runge-Kutta  method  is  called  BN-stable  if  the  approximate  solutions 
also  do  not  spread  apart  then.  The  backward  Euler  method  is  an  example  of  a 
BN-stable  formula. 

He  have  said  that  the  step  slse  should  be  restrained  so  as  to  lie  in 
the  region  of  absolute  stability,  but  codes  do  not  Impose  this  restraint 
directly.  It  is  interesting  that  the  classical  methods,  as  Implemented  In 
good  codes,  do  bring  this  about.  Some  details  are  provided  in  section  7. 
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The  commonly  used  procedures  with  Infinite  stability  regions  seem  not  to 
have  stability  difficulties  often,  but  typical  codes  do  not  handle  them  well 
when  they  do  occur •  Providing  that  a  method  with  adequate  stability  is  used, 
the  principal  restraint  on  the  step  size  is  the  iteration  restraint  discussed 
in  the  preceding  section.  We  do  not  wish  to  minimize  the  Importance  of  a 
better  understanding  of  stability  nor  of  the  need  for  more  stable  formulas 
which  are  more  easily  evaluated,  but  very  stable  formulas  which  are  apparently 
adequate  for  most  practical  problems  are  already  known. 

By  resorting  to  implicit  methods  one  can  avoid  stability  restrictions  in 
a  practically  useful  way.  There  are  costs  Involved.  One  is  the  implicitness 
already  discussed.  Another  is  accuracy.  Restricting  the  choice  of  parameters 
defining  a  Runge-Kutta  method  so  as  to  assure  good  stability  properties 
leaves  less  freedom  to  develop  very  accurate  formulas.  As  a  rule,  the 
classical  methods  with  poor  stability  are  much  more  accurate  than  those  at 
present  being  ueed  because  of  their  good  stability.  As  a  consequence,  the 
classical  formulas  permit  significantly  larger  step  sizes  (hence  are  more 
efficient)  when  accuracy  dominates  the  selection  of  the  step  size. 

6.  Accuracy 

In  section  5  the  local  truncation  error,  lte,  of  a  one-step  method  was 
defined  by  the  relation 

y(*trfl)  ■  y<xn>  +  h  ®(*n»y(*n>;h)  +  lte  • 

By  Taylor  series  expansion  one  finds  that 

lte  -  hm  *(xn,y<xn))  +  0(hP+Z)  (6.1) 

for  sufficiently  smooth  f.  In  such  a  case  the  formula  is  said  to  be  of  order  p. 
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For  methods  of  order  p  >  1  it  is  always  possible  to  choose  h  so  that 


lltel  <  h  e 


(6.2) 


Indeed  for  snail  h,  or  equivalently  snail  tolerances  e,  (6.1)  shows  that  the 
largest  h  satisfying  (6.2)  is  approximately 


hn+l  *  (e/lT(w<V)*)l/P  * 


The  smallest  step  size  needed  in  the  integration  is  approximately 


and  the  largest. 


-  (e/maxl‘c(x,y(x))»Wp 

'  C».b]  ' 

t  •  min^(b-a)t  |e/minlT^x,y(x)) 


By  way  of  example  both  the  forward  and  backward  Euler  methods  are  seen 


to  have 


lte  -  y"(xn)  +  0(h3)  . 


(6.3) 


The  general  case  of  two  stage,  second  order  explicit  Runge-Kutta  formulas 
form  a  one-parameter  family  of  formulas.  In  terms  of  the  parameter  a  +  0, 
they  are 

®(x.y;h)  -  (l-a)f (x,y)  +  af(x  +  f  y  +  h_  f(x,y))  . 


The  local  truncation  error  is 


u* '  "3[fe  ‘  ?K(,°  '  k  +  •  <6-‘> 


With  Che  exception  of  output,  none  of  the  restrictions  considered  in  this 
paper  cen  he  severe  in  the  classical  situation  when  L(h-a)  is  not  large.  It 
is  true  that,  for  example,  stability  might  restrict  the  step  size  some  so 
that  one  needs  to  consider  stability  regions  when  designing  a  code  for  non- 
stiff  problems,  but  there  cannot  be  the  kind  of  restriction  that  we  call  stiff¬ 
ness. 

Some  valuable  information  can  he  gleaned  easily  from  the  expression  for 
the  local  truncation  error  of  a  method.  We  are  now  interested  in  problems  with 
solutions  y(x)  which  are  smooth,  but  fy(x,y(x)j  is  "large.”  If  the  term  t 
in  (6.1)  Involves  fy,  it  is  often  easy  to  see  that  the  step  size  must  be 
restricted  so  that  hL  is  not  large  in  order  to  yield  the  desired  accuracy. 

This  excludes  some  methods  immediately  from  their  use  for  problems  with 
large  L.  For  example,  the  second  term  in  (6.4)  will  Impose  an  unwelcome 
restriction  on  the  step  size  when  fy  is  large. 

The  Adams -Moulton  methods  are  implicit  methods  which  use  past  solution 
values.  When  the  step  size  is  a  constant  h,  the  local  truncation  error  for 
the  method  of  order  k  has 

t  -  yj  yO*+1)(X)  , 

where  y£  1*  a  constant  characteristic  of  the  method.  A  popular  variant  of 
these  formulas  which  is  explicit  was  mentioned  earlier.  This  variant  has 

T  -  <£>0  fy(x,y(x))Yky(k)(x)  +  yJ  y(k+1)(x)  . 

The  coefficients  \  are  constants.  It  is  evident  that  this  variant 

is  unsuitable  for  problems  with  large  fy(x,y(x))  despite  whatever  merits  it 
might  have  in  the  classical  situation. 

These  observations  do  not  exclude  some  formulas  which  are,  in  fact, 


-22- 


useless.  For  example.  In  the  asymptotic  expression  (6.3)  we  do  not  see  a 
difference  between  the  explicit  and  Implicit  Euler  methods.  Still  this  is 
an  easy  way  to  see  that  some  formulas  cannot  be  helpful  when  solving  problems 
with  large  Lipschltz  constants. 

Considerable  Insight  can  be  gleaned  from  a  study  of  the  class  (2.4)  of 
problems 


y*  -  Jy  +  F(x)  . 

The  representation  (2.5)  of  the  solution, 

N 

/x  ,  ^i(x-a) 

y(x)  -  p(x)  +  7  ,  QjVje  , 

1-1 

tells  us  how  all  Integral  curves  behave  qualitatively.  Suppose  the  eigenvalues 
are  ordered  so  that 


Re(^)  <  <Re(\1)  <  <Re(X1)  , 

where  (b-a)Re(Xfl)  «  -1  and  If  Re(Xj_)  >  0,  then  (b-a)Re(Xi)  is  not  large. 

The  constants  are  determined  by  the  Initial  conditions.  The  terms  corres¬ 
ponding  to  "large"  Re(X^)  vanish  rapidly  as  x  Increases.  Me  might  say  that  the 
rapidly  varying  components  decay  out  quickly  so  that  the  solution  looks  smoother 
and  smoother.  Of  course  just  when  some  term  is  computationally  negligible 
depends  on  the  norm  and  tolerance  used. 

Generally  we  expect  to  need  a  small  step  size  to  get  accuracy  when  the 
solution  Is  changing  rapidly.  This  arises  from  the  fact  that  T  In  (6.1)  con¬ 
sists  of  various  derivatives  of  the  solution  and  of  f.  When  the  solution 
changes  rapidly,  one  expects  *  to  be  relatively  large,  although  this  is  not 
necessarily  so.  Here  we  see  that 
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f  \  /  \  ^(x-a) 

y<B)(x)  -  p(m5(x)  +  2ai>?wi* 

i-1 

There  Is  e  region  of  rapid  change  near  x  ■  a  in  which  all  derivatives  of  y(*)(x) 
are  large  and  a  snail  seep  size  is  necessary.  As  x  increases,  the  exponential 
earns  doninaee  the  factors  so  that  the  solution  looks  smoother  and 
a  larger  step  size  is  pernlsslble.  It  must  be  understood  that  if  p(x)  Itself 
is  not  easy  to  approxinate,  e.g.,  it  is  not  smooth,  then  neither  is  y(x) 
and  one  cannot  expect  hL  »  1  will  be  possible. 

If  pn  is  the  numerical  result  of  solving  (2.4)  with  initial  value  p(a) 
and  yn  the  result  with  y(a),  the  difference 

Tn  “  Pn  “  wn 

is  the  result  of  solving  the  homogeneous  problem  with  the  Runge-Kutta  method. 
Uncoupling  the  equations  again  leads  us  to  considering  how  well  6^(x)  «  \  6(x) 
is  approximated  by  our  Runge-Kutta  method.  We  saw  earlier  that 

6i<*n«.>  "  exp(\ihn+i)6i(xn) 

and 

^i,n+l  "  ^(Xihn+i)6i>n 

We  have  already  considered  when  |R(Xihn+i)|  <  1  in  the  stability  analysis. 

We  are  led  to  the  same  consideration  again  on  grounds  of  accurscy.  When  a 
solution  component  is  negligible  in  the  norm  used,  we  want  it  to  stay  negligible 
in  the  numerical  solution,  too.  The  asymptotic  expression  (6.3)  for  the 
truncation  error  did  not  distinguish  the  forward  and  backward  Euler  methods. 

They  certainly  differ  dramatically  in  the  present  situation. 
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In  qualitative  tenia,  hL  »  1  la  possible  only  when  the  solution  y(x) 

Is  easy  to  approximate  for  the  method  at  hand.  There  Is  typically  a  region 
of  rapid  change  after  which  the  solution  smooths  out  so  that  It  becomes 
easier  to  approximate.  Just  how  fast  and  how  smooth  the  solution  becomes 
depends  on  the  stability  properties  of  the  differential  equation  and  on  the 
norm  and  tolerance  supplied  by  the  user.  With  nonlinear  problems  the  solution 
may  go  through  other  regions  of  rapid  change.  Van  der  Pol's  equation  under¬ 
going  relaxation  oscillations  is  a  familiar  example. 

7.  Error  Estimator 

There  are  a  number  of  related  ways  in  which  large  llpschltz  constants 
pose  additional  restrictions  on  the  step  site.  Fundamental  to  them  Is  the 
question  of  approximating  y'(x).  With  some  methods  this  Is  a  very  natural 
task.  Indeed,  the  Adams  methods  are  best  viewed  as  methods  for  approximating 
y'(x),  rather  than  y(x).  Traditionally  the  approximation 

y£  -  f<*n,yn)  ■  y’<*n> 

Is  used.  The  function  f  is  usually  evaluated  at  (xn,yn)  anyway,  so  this 
approximation  is  often  returned  by  codes  as  an  approximate  derivative.  The 
error  of  the  approximation  Is  easily  analyzed.  For  dimensional  reasons,  the 
error  of  the  scaled  derivative  hy'Cxn)  is  more  relevant.  Now 

IhyJ  -  hy'(xn)l  -  hlf(xn,y„)  -  f(xn,y(xn))l 

<  hL»yn  -  y(*n>l  • 


If  we  know  only  that 


*yn  "  y(*n>*  <  W 
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the  beet  we  can  cay  Is  that 

*hy£  "  hy'(*n)l  <  hLp  . 

Obviously  this  approximation  is  satisfactory  only  when  hL  is  of  modest  else. 

How  can  we  generate  a  reasonable  approximation  when  the  Lipschltz  constant 
is  large?  One  way  is  to  use  only  approximations  to  the  smooth  solution  y(x)  and 
so  avoid  the  large  derivatives  associated  with  local  solutions.  Por  example , 
a  Taylor  expansion  results  in 


What  is  the  error  of  this  approximation? 

Ih  (JlIL - hy'(xn)l  <  Ky^  -  yn)  -  (yCx^)  -  y(*n>)  ■ 

+  l(y(*rrH>  "  y(xn>)  "  hy,(xn)  I 

<  2p  +  ly"(xn)l  +  0(h3)  , 

if 

•yn+l  “  y<*n+l>  1  <  P  «nd  *yn  -  y(*n)  *  <  P  • 

This  is  a  perfectly  reasonable  approximation  even  when  the  Lipschitz  constant 
is  large. 

The  truncation  error  expressions  for  the  Adams-Moulton  formulas  and  the 
BDF  Involve  only  derivatives  of  the  solution.  In  typical  Adams  codes  these 
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derivative*  ere  approximated  by  divided  difference*  of  the  f(xn,yn)  value*. 

A*  v*  have  seen,  these  values  do  not  give  a  good  approximation  to  y'Cxn)  and 
differencing  them  result*  in  even  worse  approximations  for  higher  derivatives. 
If  the  code  should  try  step  sixes  too  large  for  stability,  these  local  trunca¬ 
tion  error  estimates  are  affected;  the  higher  the  order  of  the  formula,  the 
more  the  estimator  is  affected.  Indeed,  propagated  error  due  to  instability 
"looks*’  to  the  code  like  a  solution  which  is  not  smooth.  Modern  Adams  codes, 
like  ODE,  consider  several  orders  at  a  time  and  select  that  which  appears 
most  efficient.  The  result  is  that  the  order  is  lowered  and  the  step  else 
reduced  until  the  computation  is  stable.  This  is  used  in  ODE  to  diagnose 
stiffness  when  the  code  does  a  lot  of  work.  The  typical  BDF  code  is  intended 
for  problems  with  large  Llpschltz  cone tents,  hence  must  difference  the  yn 
values  to  obtain  reasonable  estimates  of  the  truncation  error.  In  some 
codes  this  is  not  obvious  because  of  Che  representation  of  the  formula,  but 
they  are  all  doing  much  the  same  thing. 

Although  described  In  a  variety  of  ways,  all  the  popular  procedures  for 
estimating  local  truncation  error  in  explicit  Runge-Kutta  codes  can  be 
viewed  as  taking  each  step  with  two  formulas  of  different  orders  and  estimating 
the  error  of  the  lower  order  formula  by  comparison.  Obviously  this  estimate 
is  disturbed  if  the  step  size  is  such  that  either  formula  is  unstable.  The 
interesting  behavior  can  be  used  to  recognize  stiffness.  Basically  the 
situation  is  the  same  as  with  the  Adsas  codes.  Instability  looks  like 
Inaccuracy  arising  from  a  solution  which  is  not  smooth,  so  the  step  size 
is  reduced  until  the  computation  is  stable. 
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8.  Summary 

It  Is  assumed  that  the  function  f  of  (1.1)  la  continuous  and  satisfies 
tha  Lipsehlts  condition  (1.3).  This  guarantees  the  Initial  value  problem 
(1.1,  1.2)  has  a  unique  solution  y(x).  In  the  classical  situation  when  L(b-a) 
is  not  large,  this  alao  Implies  that  y(x)  is  moderately  stable.  Step-by-step 
methods  for  approximating  (1.1)  numerically  select  at  each  step  a  step  site 
hjj+i  Intended  to  satisfy  the  local  truncation  error  requirement  (S.2). 

There  are  other  restrictions  on  the  step  size,  too,  but  in  the  classical 
situation  they  cannot  be  a  severe  restriction  except  in  the  case  of  very 
frequent  output  for  some  methods  and  some  Implementations. 

To  consider  problems  with  L(b-a)  large,  we  must  assume  y(x)  is  stable. 

Some  mathematical  conditions  guaranteeing  this  have  been  stated.  Some  solution 
curves  must  approach  y(x)  very  rapidly  so  as  to  cause  L  to  be  large,  or,  as 
we  prefer  to  put  it,  in  the  reverse  direction  y(x)  is  very  unstable.  There 
is  really  nothing  new  unless  haecL  »  1  for  the  step  size  h4CC  yielding  the 
desired  accuracy.  For  this  to  happen  y(x)  must  be  "easy”  to  approximate. 
Typically  y(x)  has  a  region  of  rapid  change  in  which  haccL  is  not  large,  but 
hacc  Increases  rapidly  as  y(x)  smoothes  out  in  the  course  of  the  integration. 
All  the  classical  methods  must  restrict  the  step  size  h  actually  used  so  that 
hL  is  not  large  in  order  to  integrate  even  very  simple  problems  stably.  There 
are  formulas  which  seem  to  have  satisfactory  stability  properties,  but  they 
are  all  implicit.  The  classical  way  of  evaluating  implicit  formulas  also 
must  restrict  h  so  that  hL  is  not  large.  This  can  be  avoided  by  resorting 
to  the  expensive  simplified  Newton  iteration.  Implicit  is  the  assumption  that 
the  Jacobian  changes  slowly  along  y(x)  so  that  it  need  not  be  evaluated  "often.' 
The  classical  ways  the  local  truncation  error  is  estimated  also  Impose  a 
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restriction  that  hL  bo  not  largo.  However,  there  are  extinction  procedures 
which  do  not  suffer  such  restrictions. 

Except  for  the  ease  of  too  frequent  output,  a  problem  is  "stiff”  in  a 
region  for  a  given  code  if  the  step  site  oust  be  severely  reduced  from  that 
value  which  would  yield  the  requested  accuracy.  The  classical  situation  has 
no  stiff  problaas.  We  have  described  certain  characteristics  of  the  nathenatlcal 
problem  which  must  be  present  to  have  stiffness.  Unfortunately  stiffness  also 
depends  on  the  computational  problem,  e.g.,  norm  and  tolerance.  Furthermore, 
whether  a  given  code  exhibits  stiffness  depends  on  the  particular  formula,  how 
it  is  implemented,  and  how  it  relates  to  the  particular  mathematical  problem. 
Apparently  minor  changes  can  change  a  severe  restriction  into  none  at  sill 


Notes  on  Partitioning  in  the  Solution  of  Stiff  Equations 


by 

Fred  T.  Krogh 


Section  366 

Computing  Memorandum  488 
March  11,  1982 


California  Institute  of  Technology 
Jet  Propulsion  Laboratory 
4800  Oak  Grove  Drive 
Pasadena,  CA  91109 


Abstract 


We  describe  here  in  rough  fora  an  algorithm  for  solving  the  linear  systems 
that  arise  in  the  solution  of  stiff  systems  via  the  backward  differentiation 
formulas.  The  algorithm  is  fairly  complicated,  but  has  low  computational  cost  and 
should  be  especially  attractive  for  sparse  systems.  Identification  of  those  equa¬ 
tions  in  the  system  that  can  be  Integrated  with  the  Adams  formulas  is  a  part  of 
the  algorithm. 
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Introduction 


The  solution  of  a  stiff  differential  equation  via  the  backward 
differentiation  fomulas  Involves  at  each  step  the  solution  of  an  equation  of 
the  form 


(1) 


f(t 


n+1* 


W  ‘ 


n+1 


-  o(y 


n+1 


"  Pn+1>  “ 


where  the  subscript  n+1  indicates  the  current  step  number,  yn+^  is  the 
numerical  solution  at  the  current  time,  tn+j,  to  the  differential  equation 


(2)  y'  -  f(t,  y), 

Pq+j  and  p'n+j  are  initial  estimates  for  and  f(tfl+^,  yn+1)*  an<* 

a  is  a  parameter  proportional  to  1/h,  where  h  is  the  stepsize.  The  solution 
of  (1)  is  usually  obtained  from  a  constant  slope  Newton  method  of  the  form 


(3)  «y  «J{.  -r  -  |f<tn+1.  y„<J)  -  p-+1 

where  y*°j  -  pn+1>  y^J*15  ■  y*+j  +  6yn+l*  ®  is  an  approximation  to  C  »  J  -  ol, 
and  J  »  df/dy  evaluated  at  (tn+1,  y£+j)» 

Iteration  (3)  has  linear  convergence  with  J  j  *  O(Jwp) 

where 

a 

(4)  u  *  largest  eigenvalue  of  G  (G-C) 

In  addition,  one  can  use  the  value  of  pas  a  guide  to  the  .lumber  of  iterations 
that  are  required  to  maintain  stability  of  the  numerical  method,  see  [1]  and  12]. 
The  larger  w,  the  more  corrector  iterations  required,  until  a  point  is  reached 
that  a  new  G  is  essential* 
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Errors  in  J  and  in  a  both  contribute  to  p.  Errors  in  J  outside 
of  our  direct  control  are  assuoed  to  be  zero  for  the  purposes  of  what  we 
develop  here.  Of  course  a  code  oust  be  prepared  to  cope  with  such  errors* 

At  sooe  point  the  code  will  obtain  a  factorization  of 
(5)  Gf  ■  J  -  a  I 

and  we  wish  to  use  that  factorization  as  long  as  possible.  Initially  we  will 

A  A 

have  a  •  a  (or  perhaps,  a  *  expected  future  a)  and  we  wish  to  keep  a 

A 

useful  G  as  a  changes  due  to  changes  in  the  stepsize* 

We  propose  here  a  factorization  that  is  characterized  by  having  low 
cost  and  good  fill-in  characteristics  when  being  used  on  problems  which  have  a 
sparse  J.  A  by-product  of  the  factorization  is  that  equations  which  can  be 
integrated  with  explicit  methods  are  identified.  What  is  given  here  is  in  a 
very  unfinished  form* 

We  first  suggested  using  an  automatic  partitioning  of  stiff  systems 
into  equations  integrated  with  Adams  methods  and  equations  integrated  with  BDF 
methods  in  [3],  and  gave  some  results  with  such  a  code  in  [4].  This  early 
work  on  automatic  partitioning  attempted  to  do  this  job  without  requiring  a 
Jacobian  matrix.  We  now  believe  it  was  a  mistake  to  attempt  so  much  with  so 
little  Information.  A  test  suggested  by  Shamplne  [5]  does  a  good  job  in 
identifying  when  at  least  one  equation  in  a  system  is  stiff,  and  at  such  a 
point  it  seems  to  us  (now)  that  there  is  little  reason  to  avoid  the 
calculation  of  the  full  Jacobian  matrix. 

Enright  and  Kamel  [6]  give  an  excellent  summary  of  work  that  has  been 
done  on  partitioning.  Enright  [7]  has  done  some  work  on  investigating 
stability  for  algorithms  which  involve  mixing  different  methods. 
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An  Overview 


Row  and  column  interchanges  play  an  important  role  in  the  algorithm 
which  we  describe,  but  in  order  to  bring  out  the  essential  ideas  they  are 
little  more  than  alluded  to  in  this  section.  An  interchange  of  two  rows  is 
frequently  accompanied  by  an  interchange  of  the  corresponding  two  columns  thus 
mapping  diagonals  to  diagonals.  The  factorization  of  G^  has  the  form 

Gf  -  LUR 

where  U  is  upper  triangular,  and  L  and  R  are  both  unit  lower  triangular 
composed  of  a  product  of  elementary  matrix  transformations.  The  total  number 
of  elementary  matrix  transformations  in  L  and  R  is  <N  (the  dimension  of  G^) 
and  all  are  of  a  different  "size".  (I.e.  the  number  of  rows  or  columns 
affected  by  the  transformations  are  all  different.)  Thus  there  is  room  in  the 
space  occupied  by  G^  to  store  L,  U,  and  R.  For  example  if  N  »  7,  and  the 
factorization  consists  of  removing  factors  in  the  order  R  L  L  R  L  R,  then  the 
lower  triangle  has  the  appearance 

l 

l  l 
III 
III  r 
l  l  r  r  r 
r  r  r  r  r  r 

where  l  Indicates  an  element  of  L  and  r  an  element  of  R. 


Let  6  ■  a  -  a,  i.e.  (the  current  value  of  o)-(the  value  of 

A 

a  used  in  forming  Gf).  We  want  to  define  a  matrix  G  which  is  a  function  of 

r  * 

B  such  that  for  6  ft  0  the  spectral  radius  of  G  (G-G)  is  less  than  the 

-i  * 

spectral  radius  of  G^  (G-G^).  In  addition  the  factorization  of  G  should  be 
readily  available  from  the  factorization  of  Gf.  In  [1]  we  examine  G  •  c  Gf 


where  c  is  a  parameter  depending  on  6.  That  approach  may  give  a  fruitful 
mix  with  what  we  describe  below,  but  such  considerations  would  complicate 
considerably  what  we  present.  The  factorization  suggested  by  Enright  [8]  and 
[7],  might  also  be  useful  in  combination  with  what  we  suggest  here. 

If  diagonals  of  are  mapped  to  diagonals  of  U,  then  we  can  write 


Gf  -  LUR,  G  «  LUR  -  61,  G  ■  L  (U-D8)R 
G"1  (G-G)  -  6_1G  (LDR  -I) 

where  D  is  a  diagonal  matrix  selected  to  minimize  flLDR  -  I J  . 


Let  D  -  diag  (dR  ),  L  -  j)»  R  *  j)»  where  ^  ±  -  rt  ±  -  1, 

and  l.  *  r,  ■  0  for  j>i.  Because  of  the  way  L  and  R  are 

*  *  J  ^IJ 

constructed,  if  j<i<k  either  *  0  or  rj^j  »  0.  Thus  LDR  has  the  form 

D  +  LD  +  DR  where  L  and  R  are  the  parts  of  L  and  R  below  the  diagonal.  Thus 
the  matrix  norm  is  minimized  if 

dt  -  l/u  +  I  2  +  II  sj  2) 


or  it* 

is  zero.  Observe  that  the  smaller  we  can  make  L  and  R  the  smaller  the  norm  of 

A 

G-G.  Thus  if  a  diagonal  can  be  used  as  a  pivot,  we  multiply  on  the  left  by  L 
i?f  ||^,||  <,  H\ll  »  an<*  otherwise  multiply  on  the  right  by  R. 

*  When  diagonals  in  G^  do  not  map  to  diagonals  in  U,  things  become 
significantly  more  complicated.  In  this  case  D  is  permuted  and  some  elements 
of  8D  fall  in  L,  some  in  U,  and  some  in  R.  The  formula  given  above  for  d^ 
is  still  a  good  approximation  for  those  elements  of  BD  that  fall  in  U,  for 
those  that  fall  in  L  or  R  we  use 


where  L^  is  the  k-th  column  of  L,  R^  is  the  k-th  row  of  R,  and  either  L^ 


dk  ’  K,kl '  (l" 


k,k 


i2*l»kll 


where  0  is  the  part  of  U  above  the  diagonal,  is  the  k-th  row  of  U,  and  u^  ^ 
is  the  k-th  diagonal  of  U. 
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Although  the  algorithm  appears  fairly  complicated,  the  actual 
arithmetic  required  should  usually  be  less  than  that  required  for  a  simple  LU 
factorization*  (We  sometimes  set  matrix  elements  to  zero  to  save  Gaussian 
elimination  steps*)  We  believe  the  approach,  or  some  variant,  has  real 
promise,  but  what  is  given  here  is  perhaps  best  described  as  working  notes* 

Notation  and  More  Details. 

In  the  following  section  we  give  an  algorithm  in  a  form  something 
like  that  of  SFTRAN3,  19].  We  believe  that  anyone  familiar  with  structured 
programming  will  not  be  bothered  by  this  form  of  presentation,  even  if  totally 
unfamiliar  with  SFTRAN3.  This  section  defines  variables  used  in  the  algorithm 
and  gives  a  few  more  details  on  why  certain  choices  are  made* 

A  -  Gf  initially.  When  done,  this  area  of  storage  contains  U  above 

the  diagonal,  and  information  defining  L  and  R  below  the  diagonal. 

a.  ,  The  i,J  element  of  A. 

1»  J 

s,e  Start  and  end  indices  for  the  part  of  A  remaining  to  be  factored. 

This  includes  (a.  ,),  s<i<e,  s<j<e. 

x,  j  —  — 


q  A  flag  set  as  follows. 

q  ■  0  Up  to  this  point  there  have  been  only  row  and  column 

Interchanges  that  take  diagonals  to  diagonals.  While  q  ■  0, 
those  equations  to  be  Integrated  with  an  Adams  method  are 
identified. 

q>0  a_  did  not  start  out  as  a  diagonal  element.  Interchanges 
9  >9 

are  always  such  that  there  is  at  most  one  i,  s<i<e  for  which 

a.  ,  did  not  start  out  as  a  diagonal. 

* » * 


I 
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q—1  For  s<i<e,  a.  .  started  as  a  diagonal  element. 

While  q  ■  0,  and  perhaps  later,  equations  are  identified  which  are  such  that 
the  coupling  to  the  equation,  the  coupling  from  the  equation,  or  both  can  be 
ignored.  This  identification  is  based  on  the  following.  If 


“-1 

then  the  spectral  radius  of  (B-B^)  satisfies 
1/2 

W1  ~  p  *  u2—  p*  p*  where 

P  *  J|b  1  I’ll  c  II  *  HI  /|b!  i|*  These  results  follow  immediately  from 

*_1 

an  examination  of  the  eigenvalues  of  B^  (B-B^). 


p  used  for  temporary  storage  of  rici/|a1  A  computer 

code  would  require  more  care  in  dealing  with  potential 
overflow  or  divide  by  zero. 


p  ,p  .  maximum  and  minimum  values  computed  for  p,  s<i<e. 

D&x  min  — 


I  indices  corresponding  to  p  giving  the  p  and  p  .  . 

max  min  max  min 

If  p  .  is  not  too  large,  the  diagonal  at  i  ,  is  used  as  a 
mm  min 

pivot.  Otherwise,  the  pivot  is  max  {la.  .1,  la.  .1}  where 

s<k<e 

i  *  q  if  q>0,  and  otherwise  i  ■  i  .  It  is  hoped  that  the  use 

max 

of  i*i  will  lead  to  smaller  off  diagonal  elements  in  later 
max 

steps. 


e  A  bound  on  relative  errors  allowed  in  G.  Let  denote 

the  values  in  Table  1  of  [1]*  M  .  gives  a  bound  on  u,  the 

a  m,K 

spectral  radius  of  G  (G-G)  for  a  BDF  method  using  a  predictor 
of  order  k  and  m  iterations  on  each  step.  Choose  e  ■  c  M,  . 

J»  * 

where  c  is  a  parameter  (‘•1/2)  to  be  determined,  and  j  is 
probably  1,  but  might  be  2  depending  on  other  aspects  of  the 
algorithm. 


6 


If  at  least  one  direction  of  coupling  can  be  removed  and  the 

associated  diagonal  of  J  times  h  is  >  B.  then  an  Adams  method 

A 

is  used  on  that  equation.  This  is  justified  by  arguing  that 
if  all  is  working  as  it  should,  then  the  integration  for  every¬ 
thing  feeding  into  this  equation  is  stable  and  hence  can  be 
regarded  as  a  function  of  t,  cf*  Milne  and  Reynolds  [10].  tfe 
regard  this  test  as  a  first  step.  It  will  sometimes  use  BDF 
when  it  should  use  Adams.  (But  probably  not  vice  versa.)  The 
Adams  method  is  preferred  when  it  works  since  it  allows  a 
larger  order  and  gives  better  accuracy.  BA»-.2. 

If  at  least  one  direction  of  coupling  can  be  removed  and  the 
associated  diagonal  of  J  times  h  is  <  B^  or  if  no  coupling 
can  be  removed,  then  a  BDF  method  should  be  used  on  the 
equation.  -.6  ■  Bg  £2  B^.  When  coupling  can  be  removed 
and  Bg  <  associated  diagonal  of  J  times  h  £  B^,  then  the 
method  for  the  equation  should  not  be  changed.  Algorithms  for 
the  switch  are  given  in  [11]  in  the  case  when  the  history  of 
the  solution  is  saved  as  modified  divided  differences. 

Formulas  for  the  mix  of  algorithms  are  given  in  [12].  These 
formulas  allow  for  the  direct  integration  of  equations  with 
order  greater  than  one.  We  believe  that  such  methods  will  be 
helpful  for  mixed  differential  algebraic  systems  by  sometimes 
reducing  the  nilpotency  of  the  system. 

Bound  used  to  decide  diagonal  is  sufficiently  large  that  there 
is  no  need  to  use  some  element  off  the  diagonal.  If  for 

i*imin’  Bin  ^ri’  ci^  *  Bo|ai  i|  then  the  ^ia8on*l 
used  as  a  pivot. 

Value  to  be  used  for  a  when  equation  is  integrated  using  the 
Adams  formulas.  See  [12]  for  more  details. 
l£i£N  This  gives  information  necessary  to  update  A  when  a  or 
changes,  e^  gives  an  index  of  a  differential 
equation,  u^,  v^  give  the  row,  column  indices  where  the 
diagonal  for  equation  e^  got  mapped,  and  w^  gives  the 
weight  by  which  a  change  in  B  is  multiplied  in  order  to 
update  A.  Thus  changing  step  size  or  order  require  N 
multiplies  in  order  to  update  the  factorization.  Because 


1 


I 


I 


Pj.Xj  l<j<N 


-1 


-2 


-3 


■4 


-5 


>10 


u,  P  ,  PM,  Pg, 


8- 


6* 


permutations  are  only  applied  to  the  active  part  of  A,  a  row 
or  column  may  contain  several  elements  that  started  on  the 
diagonal*  Some  things  would  become  cleaner  if  permutations 
were  applied  to  the  entire  matrix. 

This  gives  information  on  the  interchanges  in  the  order  in 
which  they  are  done*  The  row  or  column  index  is  supplied 
by  Pj  and  Xj  tells  what  to  do  with  it. 

exchange  columns  s  to  e  of  rows  p^  and  s,  then  exchange  rows 
s  to  e  of  column  p^  and  s.  Increment  s. 
exchange  rows  s  to  e  of  columns  p  and  e,  then  exchange 
columns  s  to  e  of  rows  p^  and  e.  Decrement  e* 

Same  as  1,  except  ignore  henceforth  (treat  as  0)  elements 
below  the  diagonal  in  this  column. 

Same  as  2,  except  ignore  henceforth  elements  to  the  left  of 
the  diagonal  in  this  row. 

Same  as  3,  except  elements  to  the  right  of  the  diagonal  in 
this  row  are  also  ignored. 

Let  k«s  if  Pj>0,  k  ■  e  otherwise.  Exhange  columns  s  to  e  of 
rows  k  and  Xj-10,  then  exchange  rows  s  to  e  of  columns  k  and 
Xj-10.  Then  if  p^X)  exchange  columns  s  to  e  rows  p^  and 
s  and  increment  s.  Otherwise  exchange  rows  s  to  e  of  columns 
pj  and  e  and  decrement  e. 

g»  |  G  |  u  is  the  current  estimate  for  the  spectral 

A  |  A 

radius  of  G  (G-C)  '  g  [|s|pg  +pjj], 

I  smallest  diagonal  of  U  when  G{  was  factoredl / 

|  smallest  diagonal  of  U  currently! 

We  suggest  simplifying  g  by  using  the  smallest  diagonal  seen 
since  the  factorization  in  the  above  denominator. 

A 

o-o  (as  usual) 


gives  the  linear  part  (which  is  most  of  it)  of  the  change  in 
p  with  respect  to  6.  This  is  a  messy  one  to  compute.  If 
we  applied  row  and  column  Interchanges  to  the  whole  of  A,  then 
we  would  have 


« 


Cf  .  PlLURPr 


G  -  PlLURPr  -  61 


8 


!  8 

!  I 

\  m 


r  n 


t  - 


G  -  Pl(L  -  8Dl)  (U  -  BDy)  (R  -  6DR)PR 

where  P^  and  PR  are  permutation  matrices,  and  D^,  Dy,  and  DR 
are  sparse  weighting  matrices  that  are  non  zero  only  where  the 
permutations  carry  them  back  to  diagonals  of  the  original  matrix. 

Thus 

36  ■  PL  ‘V*  +  +  L0V  V  1 

We  propose  to  estimate  dy/dB  by  using  a  power  method  on 

*„1  j  * 

G  hr.  (G-G)]  which  if  permutations  were  as  above,  would  be 
do 

PjjWVf'1  PL(DLOil  +  UJ0R  +  LUOj  PR-  I 

With  permutations  as  we  have  defined  them  here,  the  permutations  get 
imbedded  in  the  multiplications  by  R  and  L,  and  to  do  the  multi¬ 
plications  by  Dr  and  0^  one  must  do  the  permutations  in  a  simi.'mr 

way,  using  the  Information  in  Xj,  pj,  e^  Uj,  v^  w^  all  defined 
above.  (Note  that  in  doing  this  power  method  one  does  only  matrix 
vector  multiplies,  and  some  temporary  vector  space  will  be  needed.) 

The  power  method  is  used  whenever  a  new  matrix  is  factored,  but  only 
a  few  iterations  should  be  required  since  no  great  accuracy  is  needed. 
During  the  power  method  an  estimate  for  II G  1 II  is  generated  from 

A  j 

i|zk+i  n 1  K*  where  G”  zk+i •  v 

pu  is  a  measure  of  the  error  purposely  introduced  into  the  initial 

factorization.  We  have  only  Indicated  errors  that  are  introduced  to 
save  applying  an  entire  elementary  transformation.  But  a  better 
sparse  code  should  consider  dropping  any  element  that  changes  a  zero 
to  a  nonzero.  Houbak  and  Thomsen  [13]  report  good  results  from 
setting  matrix  elements  to  0  during  a  factorization  for  some  problems. 

]|  cT‘11  an  estimate  for  the  norm  of  G~l  .  Initially  the  estimate  is  given  by 
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The  Algorithm 


Usual  BDF/ Adams  stuff 
“  -  ,•  (  8  P6  +  PM) 

If  (v  is  too  big)  Then 

Compute  new  Jacobian,  J,  if  desired. 

A  -  J  -al 


II  G'1  II  -  g  He"1 1| 

DO  (Factor  New  Interation  Matrix) 

“-I 

Compute  pg  and  ||  G  l|  using  power  method 

°M  ‘  I'6''1"  «M 
End  If 

Continue  with  usual  BDF /Adams  stuff 

(6,  g,  and  A  must  be  updated  if  a  changes.) 
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Procedure  (Factor  New  Iteration  Matrix) 


q  »  0 
8  *1 

e  -N 

set  •  i  for  Ki<e 

J  -1 

v° 

DO  (Get  Row  and  Column  Norms) 
Do  Until  (s>e) 

xi ' 1 

If  (r4  <  ct)  x}  .  2 
”  ‘‘’min  1  «**‘l  <  c> 

XJ  '  xr+  2 

°M  -  mam  «V»Bln  /«> 

* 


(Not  full  coupling) 


I£  «»  min  IK‘ II  <  '2/‘>  ‘  «V  Pj)  <  j*1(1|/l<»)  Ifn 


(Set  for  desired  Method) 


xj'5 

“M  ’  “x  <V  ‘“.in  /c2> 

End  If 

If  (q  •  0)  Then 

If  (h*(a1>1  +  a)  >  Bb)  Then 

If  (h’(*i,i  +  a)  >  V  Then 

Set  ei-th  equation  for  Adams  if  it  is  not  already. 

End  If 

If  (ef-th  equation  set  for  Adams  )  a.  -  a.  +  (a  -  a  ) 

1*1  1*1  A 

Else 

Set  ‘j-th  equation  for  BDF  if  it  is  not  already. 

End  If 
End  If 

DO  (Fix  Matrix) 
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Else 

If  (q  ■  0)  Then 
Do  For  It  «  s  to  e 

Set  equation  e^  for  BDF  if  it  is  not  already. 

End  for 
End  If 

If  (min  (rit  ci>  <  Bp  •jai  | )  Then 
Do  (Fix  Matrix) 

Else  (find  the  pivot) 

m  *  q 

If  (a  <  0)  m  -  i 

—  aax 

x_j  -  n  +  10 

a  •  0 
aax 

Do  For  k  *  s  to  e 

If  (  |a.  I  >  a _ )  Then  (Max  on  the  column) 

amax  ”  lak,a! 
i  -  k 

End  If 

If  (|*  J>a _ )  Then  (Max  on  the  row) 

K>  DAX 

amax  ”  |aa#k  I 
i  -  -k 

End  If 

End  For 

DO  (Fix  Matrix) 

End  If 
End  If 
End  Until 
End  Procedure 
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Procedure  (Fix  Matrix) 

Pj  "  1 

Do  Case  (x^) 

Case  Xj  ■  1 
k  «  s 

If  (i  k)  Then 

DO  (Exchange  Rows  and  Columns) 

End  If 

If  (i  ■  q)  Thgn 

q  -  -1 

Else 

If  (k  »  q)  q  «  i 

"k  ‘  K,kl2/<K,k12  +  'k> 

End  If  , 

Compute  and  apply  elementary  matrix  transformation  which  zeros  column 

s  in  rows  8  +  1  to  e  using  a  as  a  pivot. 

S|  s 

8  “  S  +  1 

DO  (Get  Row  and  Column  Norms) 

Case  Xj  «  2 
k  ■  e 

If  (i  +  k)  Then 

DO  (Exchange  Rows  and  Columns) 

End  If 

If  (i  »  q)  Then 
q  -  -1 
Else 

If  (k  -  q)  q  -  i 

*k  -  i*k.k|2'<|*k,k|2  +  rk> 

End  If 

Compute  and  apply  elementary  matrix  transformation  which  zeros  row  e 
in  columns  s  +  1  to  e  using  a^  as  a  pivot, 
e  ■  e  -  1 

DO  (Get  Row  and  Column  Norms)  ' 

Case  Xj  ■  3  and  x^  ■  5 

k  -  s 


PS 


If  (i  +  k)  DO  (Exchange  Rows  and  Columns) 
If  (i  “  q)  Then 
q  -  -1 
Else 

If  (k  -  q)  q  -  i 

w,  *1. 
k 

End  If 
8*8+1 

DO  (Update  Row  and  Column  Norms) 

Case  Xj  *  4 
k  -  e 

If  (1  i  k)  DO  (Exchange  Rows  and  Columns) 
If  (i  -  q)  Then 
q  -  -1 
Else 

If  (k  -  q)  q  -  i 


k 

End  If 


1. 


e  -  e  -  1 

DO  (Update  Row  and  Column  Norms) 

Case  Xj  6 
k  -  s 

If  (1  <  0)  k  •  e 

1  ■  Xj  -10 

If  (i  4  k)  Then 

DO  (Exchange  Rows  and  Columns) 

If  (q  -  i)  q  •  k 
End  If 
i  -  Pj 

If  (1  >  0)  Then 

u  »*»>«„•  K,1l2/<l*k,ilJ ♦  *£> 

If  (i  i  k)  Then 

DO  (Exchange  Rows) 

"i*  l*MJ/<K.kl2  +  r£> 

q  •  1 

Else  If  (k  -  q)  Then 
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q  ■  -1 
End  If 

Compute  and  apply  elementary  matrix  transformation  which  zeros 

column  s  in  rows  s  +  1  to  e  using  a  as  a  pivot* 

s,s 

s  ■  s  +  1 

DO  (Get  Row  and  Column  Norms) 


i  ■  -i 

if  <k,,>»k-  K,k|2 <h,kl2  +  fk) 

If  (i  i  k)  Then 

DO  (Exchange  Columns) 

“i  ■  hc.ki2  <i\.ki2  +  <=k> 

q  -  i 

Else  If  (k  «  q)  Then 

q  -  -1 
End  If 

Compute  and  apply  elementary  matrix  transformation  which  zeros  row 

e  in  columns  s  +  1  to  e  using  a  as  a  pivot. 

e»e 

e  -  e-1 

DO  (Get  Row  and  Column  Norms) 

End  If 
End  Case 
j  -  J  +  1 


End  Procedure 


* 
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Procedure  (Exchange  Rows) 

DO  For  i  •  i  to  e 

exchange  a.  and  a. 

i,o  x,o 

End  For 

Exchange  and  e^ 
u'  ■ 
v*  »  v. 

vi  ’  vk 
“i ' 1 

If  <vk  *  V  “i  ■  “k 
vk‘ v' 

°k  "  k 

If  (v'  J*  u')  ■  u' 

End  Procedure 

Procedure  (Exchange  Columns) 
Do  for  i  •  i  to  c 

exchange  a_  .  and  a  . 

By  X  D)K 

End  For 

Exchange  e^  and  efc 

v'  » 

ui  ‘  "k 
Vt  -  i 

”  <’k  *  \>  vi  ■  vk 
“k  * 
vk  ■ k 

If  (v'  i  u')  vk  -  v' 


End  Procedure 


Procedure  (Exchange  Rows  and  Columns) 

Do  for  i  •  s  to  e 

exchange  a.  and  a, 

k,m 


exchange  a  .  and  a  , 
m,i  m,k 

End  For 

Exchange  ej  and  efc 


If  (vfc  +  Uj^)  Then 
ui  "  \ 


Ul-i 

Vi  “  1 
End  If 

If  (v'  i  u')  Then 
vk  *  v' 

Uk-  U' 

Else 

vfc  -  k 

\  * k 
End  If 

End  Procedure 
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Procedure  (Get  Row  and  Column  Norms) 


p  *  0 

max 


Pmin  *  big  (big  is  a  very  large  constant) 
Do  For  i  •  $  to  e 


ri  “  LM"K.i| 


m»s 
e 


p  *  rici7  ai,i 


If  (p  >  p  )  Then 
□ax 


p  -  p 

max 


i  -  i 
max 


End  If 


!f  (P  <  Pfflin)  Then 


°«ln  *  p 


‘.in  ‘  1 


End  If 
End  For 
End  Procedure 


Procedure  (Update  Row  and  Column  Norms) 


max 


0 

p.ln  *  bl* 


Do  For  i  ■  s  to  e 
r. 


rl  “  |ai,k| 


Ci  “  lak,il 


rici/  ai,i 


If  (p  >  p  )  Then 
max 


max 


i  -  i 
max 


End  If 


If  (p  <  pmin)  11,80 


min 

lmi 
End  If 


‘.in  *  1 


End  For 
End  Procedure 
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ABSTRACT 


The  physical  relation  to  stiffness  is  examined  in  systems  with: 
chemical  reactions,  heat  and  mass  transfer  with  reaction,  diffusion,  and 
viscous  dissipation,  and  in  distillation  towers.  Physical  insights  are 
illustrated  to  reduce  computation  times,  as  compared  with  integration  by 
a  generalized  integrator.  The  advantages  and  disadvantages  of  single- 
and  multi-step  algorithms  are  considered. 


SCOPE 


Since  Curtiss  and  Hirschfelder  (1952)  introduced  the  term  "stiff" 
ordinary  differential  equation  (ODE) ,  many  authors  have  referred  to  a 
system  as  stiff  when  it  exhibits  widely- spread  response  times  and  re¬ 
quires  very  small  step-sizes  to  maintain  numerical  stability  with  some 
(all  explicit  and  some  inplicit)  integration  formulas.  In  recent  years, 
however,  generalized  algorithms  have  been  developed  to  overcome  the 
limitations  of  numerical  stability  and  refinements  in  the  definition  of 
stiff  systems  have  evolved. 

We  begin  with  a  brief  review  of  the  origin  of  the  term  stiff  and 
present  those  definitions  and  interpretations . that  we  believe  to  be  most 
useful.  Then,  stiffness  in  the  models  of  several  chemical  processes  is 
related  to  the  behavior  of  the  physical  systems.  Next,  several  approaches 
to  reduce  the  computation  time  for  integration  of  both  stiff  and  non-stiff 
systems,  mostly  utilizing  physical  insights,  are  reviewed. 

Finally,  we  focus  on  the  generalized  stiff  integrators  and  offer  our 
views  on  the  advantages  and  disadvantages  of  the  single-  and  multi-step 
algorithms. 


CONCLUSIONS 

1.  A  system  of  ordinary  differential  and  algebraic  equations  is  stiff 
if  and  only  if  numerical  integrators  with  a  stability  bound  must 
restrict  their  step-sizes  (below  that  necessary  to  give  desired 
accuracy)  to  avoid  numerical  instability.  This  restriction  can 
be  avoided  with  A-stable  or  "stiff ly-stable"  integra- 


tion  formulas,  but  with  added  computations  per  step,  usually  in- 
volving  evaluation  of  the  Jacobian  matrix.  When  a  system  is  not 
stiff,  integrators  with  a  stability  bound  can  be  used  without 
these  added  computations. 

o  quantitatively  measures  the  additional  computations  due  to  stiff 
ness,  as  compared  with  a  reference  integrator.  It  appears  to  be 
superior  to  other  measures  for  assessing  the  degree  of  stiffness. 
However,  we  have  not  completed  evaluating  a  for  a  set  of  repre¬ 
sentative  systems. 

As  suggested  by  Shampine  and  Gear  (1979),  there  is  a  relation  be¬ 
tween  stiffness  and  the  inherent  stability  of  a  system.  As  the 
system  stabilizes  its  stiffness  increases,  and  vice  versa.  This 
is  demonstrated  in  this  paper  for: 

(a)  The  Belousov  reaction  system  in  a  limit  cycle, 

(b)  coupled  heat  and  mass  transfer  with  reaction  in  a  fluidized 
bed, 

(c)  viscous  dissipation  in  fluid  mechanics,  and 

(d)  an  azeotropic  distillation  system. 

Furthermore,  as  steep  fronts  dissipate,  they  stabilize  and  the 
system  of  ODEs  stiffens.  This  is  demonstrated  for  (c)  and  (d) . 
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4.  For  partial  differential  equations,  discretization  with  additional 
grid  points  gives  an  improved  representation  of  the  system  and  its 
eigenvalues.  Additional  grid  points  introduce  larger  negative  ei¬ 
genvalues  and  the  system  often  becomes  stiff. 

5.  In  distillation,  as  trays  are  added  to  increase  purity,  the  response 
times  are  increased.  As  demonstrated  by  Tyreus  and  coworkers  (1975), 
|Re{A}|mj>n  decreases  more  rapidly  than  |Re{A}  [max  and  the  system 
stiffens. 

6.  Most  stiff  systems  experience  changes  in  degree  of  stiffness,  a, 
during  their  life  cycles.  Some  alternate  between  stiff  (step-size 
limited  by  a  stability  bound  for  explicit  and  some  implicit  in¬ 
tegrators  -  a  >  1)  and  nonstiff  u  *  1)  . 

7.  increasingly,  engineers  and  scientists  are  reporting  the  importance 
of  physical  insights  in  significantly  reducing  integration  times 
(compared  with  generalized  multi-  and  single-step  integration  methods); 
in  some  cases,  permitting  solutions  that  otherwise  could  not  be  ob¬ 
tained  with  available  computing  resources.  This  is  demonstrated 

(a)  for  chemical  reaction  systems,  when  the  fast  reactions  are  in 
local  equilibrium,  and  the  remaining  reactions  are  slow, 

(b)  using  approximations  that  permit  analytical  integration,  giving 
algebraic  equations  that  express  the  exponential  variation  in 
temperature  and  composition  -  avoiding  integration  with  small 
time-steps  to  track  such  fast  variables, 


(c)  for  coupled  heat  and  mass  transfer  in  a  fluidized  bed,  by 
eliminating  the  heat  and  mass  balances  for  the  particles  as 
the  temperatures  and  concentrations  of  the  bulk  and  particle 
phases  approach  each  other,  and 

(d)  for  distillation,  by  assuming  dVdt  *  0  when  it  is  not  neces¬ 
sary  to  accurately  track  the  liquid  flow  rates  immediately 
following  a  disturbance . 

8.  Classification  by  rate  of  change  identifies  slow  variables  that  may 
not  require  integration  or  may  permit  integration  with  a  nonstiff 
integrator. 

9.  For  reaction  systems,  the  suitability  of  the  pseudo-steady-state  ap¬ 
proximation  must  be  determined  by  experimentation . 

10.  Steady-state  algorithms  that  use  physical  insights  to  gain  efficiency 
in  the  solution  of  algebraic  equations  can  be  easily  coupled  with 
implicit  integration  algorithms.  This  is  demonstrated  for  dynamic 
simulation  of  distillation  towers. 

11.  The  advantages  of  our  new  adaptive  semi-implicit  Runge-Kutta  al¬ 
gorithm  (AS IRK  -  Prokopakis  and  Seider,  1981) ,  as  compared  with 
multi-step  algorithms  using  backward  difference  formulas  are: 

(a)  Larger  time  steps  (for  the  problems  tested) , 

(b)  the  Nordsieck  array  is  not  stored, 

(c)  AS IRK  is  strongly  A-stable,  not  stif fly-stable, 

(d)  error  estimation  and  step-size  adjustment  is  fairly  simple 
and  not  coupled  to  the  adjustment  of  order  of  accuracy 


(using  a  heuristic  methodology) ,  and 
(e)  AS IRK  permits  easy  expansion  and  contraction  of  the  number 
of  ODEs  in  time. 

12.  The  advantages  above  may  not  override  the  following  advantages  of 
the  multi-step  methods: 

(a)  The  Jacobian  is  evaluated  less  often  and  with  less  accuracy, 

(b)  the  Nordsieck  array  permits  routine  printing  at  even  intervals,  and 

(c)  multi-step  methods  are  easily  coupled  to  steady-state  algorithms 
for  solution  of  the  algebraic  equations. 

INTRODUCTION 

Curtiss  and  Hirschfelder  (1952)  were  apparently  the  first  to  intro¬ 
duce  the  term  "stiff"  differential  equation  in  connection  with  the  mass 
balances  for  the  free  radicals  in  flames.  They  explain  that:  "Free  ra¬ 
dicals  are  created  and  destroyed  so  rapidly  compared  to  the  time-scale 
for  the  overall  reaction  that  to  a  first  approximation  the  rate  of  pro¬ 
duction  is  equal  to  the  rate  of  depletion.  This  is  the  notion  of  the 
pseudo-stationary  state".  However,  they  continue:  "In  some  cases  such 
as  flames  and  detonations,  this  approximation  is  not  sufficiently  accu¬ 
rate"  and  note  the  difficulty  in  integrating  the  radical  mass  balances 
with  ordinary  numerical  procedures.  With  this,  they  introduce  backward 
difference  formulas  for  integration  of  the  so-called  stiff  differential 
equations.  However,  they  demonstrate  the  methodology  for  integration  of 
a  single  ordinary  differential  equation  (ODE)  with  slow  and  fast  response 


terms,  rather  than  the  mass  balances  for  a  reaction  system. 


Subsequently,  many  authors  have  adopted  the  adjective  stiff  and 
added  their  interpretations.  The  concise  definition  of  Aiken  and  La- 
pidus  (1974)  is  particularly  effective:  "An  m-dimensional  system  of 
initial  value  ODEs 


? ■  f(t,  £{t}}  ;  ^{0}  ■  £0  (1) 

dt 

is  called  stiff  if  the  local  Jacobian  (J  ■  Of/ 3^) )  contains  at 
least  one  eigenvalue,  X,  that  does  not  contribute  significantly 
over  most  of  the  domain  of  interest".  It  focuses  on  the  exponential 
terms  that  contribute  to  the  solution: 


X.  (t-t. )  \  (t-t, ) 

y  *  d,,e  1  1  +  ...  +  d„_e  m  1 


1  11 


lm 


(2) 


X. (t-t.)  *  X-tt-ti) 

ym  =  d  e  X  1  +  ...  +  d  e® 

m  ml  mm 


where  Hs  a  vector  of  eigenvalues  and  dL  the  eigenvectors  of  J  evalu¬ 
ated  at  t^.  When  Re{X^}  is  large  negative,  its  exponential  terms  de¬ 
cay  rapidly  and  do  not  contribute  significantly. 

The  problem,  of  course,  with  stiff  systems  is  that,  to  keep  the 
truncation  errors  bounded  (maintain  numerical  stability) ,  simple  explicit 
(and  some  implicit)  integration  methods  require  a  step-size  that  decreases 
inversely  with  the  magnitude  of  the  largest  negative  eigenvalue.  Imprac- 
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tically  small  step-sizes  are  required,  giving  local  truncation  errors 
much  smaller  than  necessary,  with  the  possible  accumulation  of  round-off 
errors  that  can  invalidate  the  solution.  Whereas  in  the  fast  transient 
(non-stiff)  regions,  when  the  step-size  is  reduced  to  accurately  track 
the  rapidly  changing  variables ,  further  reduction  to  satisfy  the  sta¬ 
bility  bounds  is  unnecessary. 

Then,  a  system  is  stiff  if  and  only  if  numerical  integrators  with 
a  stability  bound  (all  explicit  and  some  implicit  integrators)  must  re¬ 
strict  their  step-sizes  to  avoid  numerical  instability.  This  restriction 
can  be  avoided  with  A-stable  or  "stif fly-stable"  integration  formulas 
(permit  any  step-size  without  numerical  instability)  but  with  added  com¬ 
putations  per  step,  usually  involving  evaluation  of  the  Jacobian  matrix. 
When  a  system  is  not  stiff,  integrators  with  a  stability  bound  can  be 
used  without  these  added  computations. 

The  most  widely  used  measure  of  stiffness  is  the  so-called  "stiff¬ 
ness  ratio". 


SR 


|  Re  { X  }  | 

|  Re(x}  | 


max 

min 


(3) 


Despite  its  simplicity,  however,  SR  has  two  important  limitations:  (1) 
stiffness  is  not  a  function  of  |Re{X>|min  (although  the  range  of  inte¬ 
gration,  “  t  »  is  often  on  the  order  of  1/ | Re{\} !w,n) ,  and  (2) 

the  system  is  normally  not  stiff  in  rapid  transient  periods  (regardless 
of  1  Re { X } | max) - 


Byrne  (1981)  suggested  a  superior  measure 


s 


t-,  ,  "  t 

final  o 

Tmin 


(4) 


"providing  the  solution  is  slowly  varying  on  most  of  the  interval", 

where  t  .  is  the  smallest  time  constant,  t.  *  -l/Re(X.}.  Furthermore, 
min  j  j 

to  paraphrase  Byrne,  if  t  .  is  small  over  a  time  interval  many  times 

min 

longer  and  the  solution  is  slowly  varying  on  the  interval,  the  system  is 

stiff.  However,  "if  t_.  ,  -  t  =  t  .  or  the  solution  is  always  rapidly 

final  o  min 

varying,  the  system  is  not  stiff".  Eqn.  (4)  is  superior  to  Eqn.  (3), 
but  is  weakened  by  the  qualitative  requirement  that  the  solution  must 
vary  "slowly". 

An  improved  measure  is: 


a 


(5) 


where  h^  is  the  step-size  to  satisfy  the  local  truncation  error,  e, 
and  h^  is  the  step-size  to  satisfy  the  stability  bound  for  a  reference 
integrator  that  is  not  A-stable;  i.e.: 


h£  h£  <  o'{r>/|Re{X>  |max 

5{r}/!Re{A}|  h  >  5 { r > / 1 Re { X > | 

max  e  —  1  'max 


where  5{r}  is  the  real  stability  bound  for  the  reference  integrator  of 
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order  r  and  h£  is  estimated  using  an  integrator  of  the  same  order.  Of 
course,  a  is  more  difficult  to  compute  than  SR,  but  a  is  a  direct  meas¬ 
ure  of  the  additional  computations  by  the  reference  integrator  due  to 
stiffness  and,  as  such,  a  measure  of  the  degree  of  stiffness.  An  evalu¬ 
ation  of  0  is  currently  underway  for  representative  systems. 

An  additional  perspective,  concerning  the  source  of  stiffness,  is 
offered  by  Shampine  and  Gear  (1979) :  "By  a  stiff  problem,  we  mean  one 
for  which. ..at  least  some  component  is  very  stable  (at  least  one  eigen¬ 
value  has  a  real  part  which  is  large  and  negative) " .  This  suggests  a 
relation  between  stiffness  and  the  inherent  stability  of  a  system,  which 
we  explore  for  many  chemical  processes  in  the  next  section. 

PHYSICAL  RELATION  TO  STIFFNESS 

The  coupling  of  slowly  and  rapidly  changing  processes  is  the  most 
obvious  cause  of  stiffness.  Given  a  slow  process,  the  rapid  process 
introduces  large  negative  eigenvalues  in  the  exponential  components  of 
the  dependent  variables.  When  the  slow  process  is  rate-controlling 
(all  variables  respond  slowly),  the  coupled  system  is  stiff.  However, 
given  a  fast  process,  the  coupled  system  is  stiff  only  when  the  depen¬ 
dent  variables  respond  slowly.  As  examples,  fast  controllers  do  not 
alter  the  response  times  of  slow  processes,  but  the  differential  equa¬ 
tions  that  describe  the  closed  loop  are  stiff.  In  distillation,  some 
of  the  vapor  and  liquid  flow  rates  leaving  the  trays  (small,  hold-up) 
continue  to  vary  rapidly  when  coupled  to  a  slow  reboiler  (large  hold-up) . 
After  rapid  changes  in  the  flow  rates,  the  coupled  system  responds  slowly 
and  the  MESH  (Material  balance,  Equilibrium,  Summation  of  mole  fractions, 
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and  Heat  bailee)  equations  become  stiff. 


Chemical  Reaction  Systems 

The  dynamics  of  many  chemical  reaction  systems  can  be  adequately 
described  with  reactions  involving  molecular  species.  The  intrinsic 
rates  of  forward  and  back  reactions  are  relatively  slow  (as  compared 
with  reactions  involving  free  radicals  and  ionic  species)  and  the  mass 
balances  are  usually  not  stiff.  Hence,  with  integrators  having  a  sta¬ 
bility  bound  (so-called  "nonstiff"  integrators  -  all  explicit  and  some 
implicit  methods),  the  step-size  is  not  reduced  below  that  to  give  de¬ 
sired  accuracy. 

For  some  systems,  such  as  in  pyrolysis,  reforming,  and  combustion, 
reactions  involving  free  radicals  are  necessary  to  give  an  adequate 
representation  of  conversion  in  time.  These  fast  reactions  introduce 
large  | Re { X  > | .  At  times  when  the  concentrations  of  the  molecules  and 
radicals  respond  slowly,  the  mass  balances  are  usually  stiff;  with 
widely-spread  response  times  they  may  not  be  stiff. 

Pyrolysis  and  reforming  systems  are  endothermic  and,  hence,  nearly 
isothermal  in  industrial  furnaces.  In  contrast,  combustion  systems  are 
highly  exothermic  with  rapid  rises  of  temperature  and  conversion  in  the 
flame  front.  The  high  sensitivity  of  reaction  rates  to  temperature, 
usually  described  by  the  Arrhenius  equation: 


k 


,  -E/RT 
k  e 
o 


(4) 


causes  all  reactions  to  be  accelerated. 


Both  | Re { X } | max  and  the  response 


times  of  the  concentrations  increase  and  stiffness  of  the  differential 
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equations  depends  upon  the  largest  rate  of  change  in  concentration. 

Limit  Cycles 

Shan$>ine  and  Gear  (1979)  refer  to  the  Van  der  Pol  equation  as  an 

example  of  a  limit  cycle  that  is  intermittently  stiff  and  nonstiff. 

Another  example  is  the  Belousov  reaction  system,  studied  by  Prokopakis 

and  Seider  (1981)  with  the  kinetic  model  of  Field  and  Noyes  (1974). 

For  a  mixture  of  1.25M  H2S04,  0.0125M  KBrC>3>  0.001M  Ce  (NH4)  2  (N03 ) 5» 

and  0.02SM  CH^(COOH) Field  and  Noyes  derive  the  mass  balances  for 

4+ 

the  intermediates  HBr02»  Br  ,  and  Ce  ,  with  dimensionless  concentra¬ 
tion,  y  ,  y2,  y3,  respectively: 

<*y -i  t 

77.27(y2  -  y^  +  yx  -  8.375x10  yj)  ;  y1(0>  =  4  (6) 

dy2  _  ~y2  ~  Yiy2  *  y3  ;  y  {0}  -  1.1  (7) 

dt  77*.  27 

dy3 

^T~  ■  0.161  (y^  -  y3)  ;  y3(0}  *  4  (8) 

The  period  of  the  limit  cycle  is  300s  as  illustrated  in  Figure  1.  Note 
that  the  bold  curves  in  Figure  lb  denote  the  fastest  changing  variable, 
the  so-called  "stiff  variable".  Table  1  shows  the  eigenvalues  of  the 
system  which  vary  by  at  most  four  orders  of  magnitude  (and  usually  far 
less)  during  the  rapid  transients,  or  steep  concentration  fronts.  In 
this  region,  the  system  is  not  very  stiff;  probably  a  nonstiff  integrator 
could  be  used  without  unduely  small  step-sizes.  Then,  the  system  gains 
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inherent  stability ,  with  =  1. 33x10"*.  Since  the  concentrations 

change  more  slowly,  the  system  becomes  stiff  and  the  stiffness  increases 
as  it  stabilizes.  At  longer  times,  the  system  slows  further  and  |\| 
decreases  as  instability  sets  in,  just  prior  to  the  rapid  transient. 
Consequently,  stiffness  decreases  with  destabilization. 

Another  limit  cycle,  of  environmental  interest,  involves  the  re¬ 
actions  of  atomic  oxygen,  0,  oxygen,  O^,  and  ozone,  0^,  in  the  atmosphere. 
In  the  mechanism  of  Chapman  (Dickenson  and  Gelinas,  1976)  : 


0  +  o2  - »  o3 


0  +  03  '  2C>2 


k,{t} 

02  »  20 


k*  { t } 


■♦0+0, 


reactions  (3)  and  (4)  require  photochemical  energy  and  have  rate  con¬ 
stants  that  vary  diumally: 


-c . /sin  wt 
e  i 


k.  (t}= 
i 


0 


sin  wt  >  0 


sin  wt  <  0 


i-3,4 


(9) 


where  half  the  frequency  of  oscillation,  w  =  ir/43200  s  ^  (=Tr/12hr  S  and 
c 3  =  22.62  and  c^  *  7.601.  These  rate  constants  rise  rapidly  beginning 
at  dawn  (t  »  0,24, 48hr, . . . ) ,  reaching  a  peak  at  noon  (t=6 , 30, 54hr , . . . ) , 


-13- 


and  decreasing  to  zero  at  sunset  (t*12 ,36,60hr, . . . ) .  The  mass  balances 
for  0  and  03  are: 

dyi  6  -2 

dt“  *  ~kiyiy3  '  k2YlY2  +  2k3tt^y3  +  k4^t^y2  •  =  10  cm  (10) 

dy?  12  -3 

dt~  =  klYlY3  "  k2YlY2  "  k4^t}y2  '*  y2{°*  =  10  01  (11) 

where  y  ,  y2,  y^  are  concentrations  of  0,  03,  and  O^,  respectively,  and 
k^  *  1.63x10  16  and  k2  ■  4.66x10  16 .  When  integrated  with  y^  3  3.7xl016cm  3 
0  traverses  a  limit  cycle  while  03  builds  just  prior  to  noon  and  remains 
constant  at  other  times,  as  illustrated  in  Figure  2.  Note  that  y^  drops 

^  _3  _3q  — 3 

from  10  cm  initially  to  virtually  zero  (<10  cm  j  within  one  minute 

-2  -2  -3 

and  builds  to  2.92x10  in  one  hour.  Similarly,  y^^  drops  from  3.15x10  cm 

after  11  hours  to  virtually  zero  after  12  hours,  where  it  remains  until 
24  hours.  At  24  hours,  the  rapid  rise  begins.  The  rates  of  change  and 
eigenvalues  are  given  in  Table  2.  is  nearly  constant  and  reflects 
the  rate  of  change  of  the  system.  | |  increases  toward  noon  as  the  sys¬ 
tem  accelerates  and  decreases  toward  sundown  as  the  system  decelerates. 

Since  the  rates  of  change  are  very  slow  at  night,  the  system  is  very  stiff. 
However,  throughout  most  of  the  daytime,  with  rapid  rates  of  change,  the 
system  is  nonstiff. 

Heat  and  Mass  Transfer  with  Reaction 

Models  that  couple  heat  and  mass  transfer  between  a  bulk  fluid  phase 
and  a  solid  catalyst  are  justified  when  the  resistances  to  heat  and  mass 
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transfer  are  important.  Such  a  model  is  presented  by  Luss  and  Amundson 
(1968)  to  represent  the  dynamics  of  a  batch  fluidized-bed  reactor  where 
external  resistances  are  significant.  The  mass  and  heat  balances  for 
the  bulk  phase  are: 

"  Pe  *  P  +  Hg<Pp  “  P>  *  “  Pe  (12) 

~  =  T  -  T  +  H_(T  -  T)  +  H  (T  -  T)  ?  T{0}  *  T  (13) 

dt  e  T  p  w  w  e 


and  for  the  reacting  catalyst: 

dp 

A  *  -H  Kkp  +  H  (p  -  p  )  ;  p  {0}  -  p«  (14) 

dx  g  p  g  p  p  p 

dTp 

c  3r  =  V^p  +  nT(T  ~  Tp>  t  Tp{0}  *  Tp  (15) 


where  T  and  p  are  the  tenperature  and  partial  pressure  of  species  A  in 

the  bulk  phase?  T  and  p  ,  the  particle  properties?  T  ,  p  ,  the  entrance 
p  p  e  e 

conditions?  and  k,  the  rate  constant  for  a  first-order  reaction,  A  -*■  B. 
The  results  of  Luss  and  Amundson  (1968)  are  illustrated  in  Figure  3. 
Using  the  explicit  Runge-Kutta  Gill  integration  formula,  the  step-size 


is  small  initially  and  decreases  as  T^  -*■  T  and  p  -*■  p,  with  decreasing 


rates  of  change.  Because  A  increases,  as  shown  above,  stiffness 

'  1  max  - 


increases  with  stabilization. 
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Diffusion 

The  dimensionless  diffusion  equation: 

3c  32c  n6 

—  -  — «r  (16 

3t  3x^ 

c{0,t}  *  c{l,t}  ■  0  ;  c{x,o}  given 

is  often  integrated  using  the  method  of  lines  with  a  second-order  finite 

2  2 

difference  approximation  for  3  c/3x  .  The  resulting  ODEs  are: 


-2 


1 


1-2  1 


dg 

dt 


*  (n+1)2 


2  1 


(17) 


T 

where  n  is  the  number  of  equally-spaced  intervals  and  c  *  [c  ,...,c  ] 

—  o  n 

is  a  vector  of  approximations  to  c  at  n+1  grid  points. 

An  interesting  observation  is  that  as  n  increases  | X | may  of  j  in¬ 
creases,  as  illustrated  in  Table  3.  Consequently,  stiffness  of  the  ODEs 
increases  with  n. 

At  first  glance,  the  increased  stiffness  appears  to  be  due  solely 
to  the  spacial  discretization.  However,  Shampine  and  Gear  (1979)  show 
that  the  eigenvalues  of  J  are: 


« 
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ll 


A..  -  -  [2  (n+1) sin{  jir/[2  (n+1)  ]  }]‘ 


Ax  *  —IT 


A  ,  =  -4(n+l)‘ 
n-1 


which  correspond  to  the  eigenvalues  of  the  diffusion  equation,  -(jir)  , 
j  *  1,2...  They  note:  "The  first  eigenvalue  of  the  discretized  system 
is  approximately  the  first  eigenvalue  of  the  differential  operator,  and 
the  others  are  approximations  to  some  of  the  larger  ones".  This  points 
out  that "stiffness  is  inherent  in  the  problem  (we  prefer  model) ,  not 


part  of  the  method  of  solution". 


Viscous  Dissipation 

The  dimensionless  momentum  balance  with  viscous  dissipation  in  one 
spa  Ial  dimension: 


3u  3u  ,  ,  32u 

3t  3x  Sx7 


with  the  boundary  conditions  of  Burger 


u{t,0>  *  ${t,0} 
u{t,l>  =  #{t,l} 
u{0,x}  *  ${0,x} 


has  the  analytical  solution: 


0.1e~A  +  0.  Se~B  -t-  e~C 

-A  -B  -C 
e  +  e  +  e 


#{x,t} 


(20) 


A  -  (x  -  0.5  +  4 .95t) 


B  »  -=-=■  (x  -  0.5  +  0. 075t) 
U 


C  *  -  (x  -  0.375) 


Equation  (19)  has  been  integrated  with  the  method  of  lines,  using  a 

2  2 

five-point  central  difference  approximation  for  3  u/3x  and  a  third-order 
four-point,  upwind  finite  difference  approximation  for  3u/3x.  Such  an 
approximation  is  found  to  improve  the  tracking  of  step  waves  when  the 
viscosity,  u  *  0  (Carver,  1976  and  Hu  and  Schiesser,  1981) 

With  the  grid  spacing  Ax  *  0.01,  we  integrated  the  ODEs  to  give  the 
solution  in  Figure  4,  which  compares  favorably  with  the  analytical  solu¬ 
tion.  Of  course,  as  u  increases,  viscous  dissipation  spreads  the  fronts 
a?  shown. 


Table  4  shows  that  1  Re { A > |  increases  as  y  increases  (du./dt) 

1  1  max  i  max 


decreases  in  the  less  steep  fronts  and  the  system  gains  inherent  stabilit 
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c 

1 

1 

I 

.  . 

s 


tillation  tower,  as  illustrated  for  the  separation  of  propane  from 
n-butane  in  Figure  5.  The  trays  (small  hold-up)  respond  rapidly  to 
changes  in  flow  rate,  but  the  large  reboiler  slows  the  coupled  response. 
After  the  initial  rapid  transients,  the  MESH  OOEs  become  stiff  as  com¬ 
positions  and  temperatures  respond  slowly.  For  separation  of  propane 
from  n-butane,  the  Jacobian  of  the  mass  balances: 


dx. 

dt 


G.x. 

“3~j 


j*l, ...  ,C 


(21) 


T 

gives  a  measure  of  the  stiffness.  In  Eqn.  (21),  *  [x^ ^ , . . . >xNjl  * 

where  x_  is  the  mole  fraction  of  compound  j  in  the  liquid  on  Tray  i. 

N  is  the  number  of  trays  and  C  the  number  of  chemical  species.  is 

the  tri-diagonal  coefficient  matrix  due  to  the  coupling  of  Tray  i  to 

Trays  i+l  and  i-1  (as  illustrated  in  the  Appendix) . 

It  is  interesting  that  as  the  product  purities  approach  unity 

(e.g. ,  x  _  -*■  1  and  x,  .  .  -*•  1),  N  increases  and  the  mole 

n, propane  1, n-butane 

fractions  respond  more  slowly.  This  is  demonstrated  by  Tyreus  and  co¬ 
workers  (1975)  who  show  that  Ulmin  decreases  more  rapidly  than  | 

Hence,  for  difficult  separations  (with  large  pinch  zones  -  adjacent  trays 
with  small  concentration  differences),  the  MESH  equations  become  stiffer 
as  the  response  times  increase.  This  effect  is  also  demonstrated  for  de¬ 
creasing  relative  volatility,  ajr  *  K^/K^. 


« 


Azeotropic  Distillation 


Typical  operating  conditions  for  an  azeotropic  distillation  tower 
to  dehydrate  alcohol  are  shown  in  Figure  6.  The  trays  in  t,  •  upper 
portion  of  the  stripping  section  have  very  small  changes  in  alcohol 
and  entrainer  concentration  while  water  is  removed.  Then,  in  a  few 
trays,  the  alcohol  mole  fraction  is  increased  to  near  unity  as  the  en¬ 
trainer  is  eliminated.  These  trays  respond  more  rapidly  than  others 
in  the  stripping  section,  as  illustrated  in  Figure  7,  which  shows  the 
profiles  of  liquid  mole  fractions  after  a  thirty  percent  increase  in 

the  feed  flow  rate. 


REDUCTION  IN  COMPUTATION  TIME 

Many  models,  involving  ordinary  differential  and  algebraic  equa¬ 
tions,  are  stiff  during  part  of  their  life  cycles.  Consequently,  mod¬ 
elers  are  turning  to  the  generalized  multi-  and  single-step  methods  for 
integrating  systems  of  stiff  ODEs.  Although  these  methods  arg  success¬ 
ful  for  many  systems,  increasingly  engineers  and  scientists  are  reporting 
the  importance  of  physical  insights  in  significantly  reducing  computation 
times;  in  some  cases,  permitting  solutions  that  otherwise  could  not  be 
obtained  with  available  computing  resources.  It  is  noteworthy,  however, 
that  some  approaches,  presented  in  the  name  of  eliminating  stiffness. 
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rather  reduce  the  computation  time  for  nonstiff  systems.  There  appears 
to  be  confusion  regarding  the  properties  of  stiff  systems  which,  hope¬ 
fully,  the  previous  sections  have  helped  to  clear-up. 

In  this  section,  we  consider  a  number  of  approaches  for  reducing 
computation  times. 

Linearization 

For  systems  that  are  mildly  nonlinear,  linearization  from  time-to- 
time  can  offer  an  efficient  solution  method.  At  appropriate  times,  t^, 
the  linear  approximation  is: 

;  £{ti>  "  Lj.  <22> 

The  Jacobian ,  J,  is  computed,  as  well  as  its  eigenvalues,  , 

*  1  m 

and  their  corresponding  eigenvectors,  dL,  j*l,...,m.  Then,  the  analytical 
solution,  Egn. (2), is  used  for  t^  <  t  t^+^,  where  the  step-size,  h  - 
t^+^  -  t^,  within  which  acceptable  accuracy  is  obtained,  is  determined 
by  the  nonlinearitiec .  Mah  and  coworkers  (1961)  applied  this  repeated 
linearization  with  some  success  for  integration  of  the  mass  balances  in 
distillation.  However,  the  approach  has  not  been  widely  adopted,  pri¬ 
marily  due  to  difficulties  in  adjusting  the  step-size  and  the  complexity 
of  calculations  to  determine  J  and  its  eigenvalues  and  eigenvectors. 

Of  course,  for  linear  systems,  such  as  networks  of  first-order  re¬ 
versible  reactions  among  isomers  (Wei  and  Prater,  1962) ,  Eqn.  (2)  is 


the  analytical  solution. 
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Classification  by  Rate  of  Change 

For  systems  that  exhibit  widely-spread  rates  of  change  (usually 
not  stiff,  unless  | Re{l} |  is  sufficiently  large  to  require  that  a 
nonstiff  integrator  reduce  its  step-size  below  that  necessary  to  ac¬ 
curately  track  the  fastest  variables) ,  significant  savings  in  integra¬ 
tion  time  can  often  be  achieved  by  classifying  the  variables  according 
to  rate  of  change.  Let  the  m  ODEs  be  listed  in  order  of  descending 
magnitude  of  rate  of  changes 


y1  - 

y2  - 

(23) 

•  « 

•  • 

where  |y.J>>|ymj  .  Some  authors  refer  to  y^  as  the  "stiff"  variable  (Aiken 

and  Lapidus,  1974;  Prokopakis  and  Seider,  1981)  and  y,  ,...,y  (where  n 

l  n 

is  arbitrary)  as  the  stiff  variables  with  y  y  as  "nonstiff"  vari- 

n+x  m 

ables.  Since  the  system  may  not  be  stiff,  we  prefer  to  replace  these 
with  the  adjectives  "fast"  and  "slow". 

In  some  cases,  it  may  not  be  necessary  to  accurately  track  the 
fast  variable (s).  If  not,  their  derivatives  can  be  approximated,  say, 
with  a  first-order  finite  difference  or  as  zero  (pseudo-steady-state 
assumption),  resulting  in  algebraic  equations.  The  resulting  ODEs  (with 
the  slower  rates  of  change)  permit  larger  step-sizes  to  accurately  track 


the  slower  variables.  However,  with  rates  of  change  in  closer  proximity, 
they  are  more  likely  to  be  stiff,  requiring  an  implicit  or  semi-implicit 
algorithm  with  evaluations  of  the  Jacobian,  J.  Normally,  the  increase 
in  h  reduces  computation  time  far  more  than  that  added  to  evaluate  J. 

This  is  demonstrated  for  a  12  tray  azeotropic  distillation  tower 
to  dehydrate  isopropanol  with  cyclohexane,  as  illustrated  in  Figure  8. 

The  primary  feed  is  on  Tray  9  and  the  reflux  from  the  decanter  is  as¬ 
sumed  to  remain  constant.  Initially,  Trays  10-12  are  at  the  feed  com¬ 
position,  and  Trays  1-9  have  a  linear  decrease  in  mole  fraction  of  cy¬ 
clohexane  with  the  ratio  of  isopropanol  to  water  equal  to  that  in  the 
feed.  Also,  initially  L°  ■  85  mol/min  and  -  566.7  mol/min  and  the 
remaining  L^  and  are  those  at  constant  molal  overflow.  The  simulation 
begins  holding  the  boil-up  ratio,  V^/L^,  fixed  at  6.67.  Cyclohexane  is 
initially  concentrated  at  the  bottom  of  the  tower  and  the  dynamic  re¬ 
sponse  involves  an  inversion  in  concentration  profiles.  The  results  of 
two  integrations  are  compared  in  Table  5,  one  with  x  and  L  as  state- 
variables,  (Eqns.  (21)  and  (A10)),  the  other  assuming  dL/dt  *  0  (Proko- 
pakis  and  Seider,  1982) .  As  expected,  very  small  time-steps  are  nec¬ 
essary  to  accurately  track  L.  With  the  pseudo-steady-state  assumption, 
after  0.075  min  L  begins  small  oscillations  about  the  true  solution, 
whereas  the  mole  fractions  are  in  good  agreement  throughout  the  inte¬ 
gration.  After  23  min,  the  liquid  flow  rates  agree  to  five  significant 
figures.  In  many  situations,  these  small  oscillations  in  flow  rates  in 
the  early  transient  are  insignificanc  over  the  2-3  hours  to  achieve  a 
steady-state.  Note  that  a  first-order  finite  difference  approximation 
for  dL/dt  gives  intermediate  accuracy. 
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Shampine  and  Gear  (1979)  state:  "Current  codes  for  stiff  dif¬ 
ferential  equations  are  sufficiently  efficient  that  there  is  no  need 
to  consider  such  model  changes  for  most  problems  for  reasons  of  cost, 
and  there  are  excellent  reasons  of  convenience  and  theoretical  support 
for  not  changing  the  model.  To  be  sure,  there  are  exceptions  because 
we  are  discussing  general  purpose  codes”.  We  believe  that  the  MESH 
equations  in  distillation  constitute  such  am  exception. 

In  other  cases,  the  slowest  variables  may  be  changing  too  slowly  to 
require  integration  or  when  the  rate  of  change  is  significant,  it  may  be 
possible  to  integrate  their  ODEs  with  a  nonstiff  integrator  (if  | Re { X > | 
is  sufficiently  small) .  Such  decompc sitions  are  recomnended  by  Prokopakis 
auid  Seider  (1982)  for  integration  of  the  MESH  equations  in  distillation 
and  by  Edsburg  (1980)  for  integration  of  the  mass  balances  in  reaction 
systems . 

For  pyrolysis,  reforming,  and  combustion  models,  where  the  need  to 
include  the  fast  reactions  involving  free  radicals  is  generally  acknowl¬ 
edged,  there  is  question  concerning  the  applicability  of  the  pseudo-steady- 
state  assumption  (PSSA)  for  radical  concentrations.  Blakemore  and  Cor¬ 
coran  (1969)  postulate  a  free  radical  mechanism  for  the  pyrolysis  of 
n-butane  and  integrate  the  mass  balances  with  and  without  the  PSSA. 

After  10  msec  in  a  batch  reactor  at  519°C  they  show  negligible  difference 
in  the  radical  concentrations,  with  no  changes  in  the  radical  concentra¬ 
tions  thereafter.  With  the  PSSA,  the  step-size  for  their  nonstiff  in¬ 
tegrator  is  increased  significantly,  presumably  because  the  resulting 
ODEs  are  non stiff. 
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However,  others  question  the  suitability  of  the  PSSA.  Sundaram 
and  Froment  (1978)  studied  the  pyrolysis  of  propane  with  a  free  radical 
mechanism  at  800aC  and  found  significant  errors  in  the  PSSA.  Further¬ 
more,  Edelson  and  Allara  (1973)  report  that,  using  the  model  of  Herriott 
and  coworkers  (1972)  for  propane  pyrolysis,  three  of  the  radicals  do 
not  achieve  a  steady-state  simultaneously  and  H»  atom  does  not  achieve 
a  steady- state  at  all. 

It  seems  clear  that  the  PSSA  is  appropriate  for  some  reaction  systems 
and  not  for  others.  Unfortunately,  the  rates  of  change  of  the  fast  for¬ 
ward  and  reverse  reactions,  or  any  other  measure  (to  our  knowledge),  does 
not  indicate  its  appropriateness.  The  suitability  of  the  PSSA  must  be 
judged  by  experimentation.  Since  this  involves  integrating  the  unabridged 
ODEs,  it  is  pointless  to  make  the  assumption  unless  repeated  integrations 
are  planned  with  small  changes  in  the  parameters. 

Chemical  Equilibrium 

In  chemical  reaction  systems,  it  may  be  possible  to  reduce  compu¬ 
tation  times  if  some  of  the  reactions  are  in  local  equilibrium  (i.e.r 
have  equivalent  forward  and  back  reaction  rates);  for  example,  if  the 
reaction: 

kfor. 

H  +  0  _ _  0  +  OH 

krev 

is  in  local  equilibrium,  the  forward  and  reverse  rates  of  reaction  are 


equal : 
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r  =  k  c  c  =  r  =  k  cc 
for  for  H  02  rev  rev  0  OH 


(24) 


and 


,  Voh 

krev  CHCQ2 


(25) 


where  K  is  the  chemical  equilibrium  constant. 

Sorensen  and  Stewart  (1980)  present  a  method  to  determine  an  in¬ 
dependent  set  of  mass  balances  when  a  subset  of  the  reactions  can  be 
taken  at  equilibrium.  They  identify  R  basic  species,  where  R  is  both 
the  number  of  independent  reactions  and  mass  balances.  The  R  basic  spe¬ 
cies  are  divided  arbitrarily  into  A  and  B  subsets.  There  are  NB  of  the 
B  species,  one  for  each  of  an  independent  set  of  reactions  taken  at  equi¬ 
librium.  There  are  NA  of  the  A  species,  one  for  each  of  R  -  NB  reactions 
not  taken  at  equilibrium  that  form  an  independent  set  with  the  reactions 
taken  at  equilibrium.  Then,  with  row  eliminations,  NA  mass  balances  are 
derived  that  do  not  involve  the  rates  of  reactions  taken  at  equilibrium. 

White  and  Seider  (1981)  apply  this  method  to  a  system  of  21  reac¬ 
tions  for  combustion  of  H  and  CO  in  air,  with  7  reactions  taken  at 
equilibrium.  The  8  independent  mass  balances  are  reduced  to  4,  since 
there  are  4  independent  reactions  at  equilibrium,  and  have  the  form: 


d£ 

dt 


=  f{r  } 
- n 


(26) 


where  £  is  a  linear  combination  of  concentrations  (e.g.,  5^  =  cNQ  +  c^ 

+  c  -c,5*  c  +  2c0  +  c  +  2cq/ — )  and  r  is  a  vector  of  net 

H2  O2  2  OH  u2  “  —  n 

rates  of  reaction  for  reactions  not  taken  at  equilibrium.  White  and 

Seider  use  the  GEAR  integrator  to  give  £  across  a  time-step.  Then,  the 
concentrations,  c,  are  computed  using  the  Rand  method  (Newton's  method) 
to  minimize  the  Gibbs  free  energy  given  £.  For  this  system,  computation 
times  are  not  reduced  primarily  because  the  reactions  not  taken  at  equi¬ 
librium  are  fast  as  well  as  slow.  They  conclude  that  computation  times 
should  be  reduced  when  all  reactions  not  at  equilibrium  are  relatively 
slow,  reducing  the  rates  of  change,  d?/dt,and  probably  the  stiffness  of 
Eqn.  (26) .  This  should  permit  large  time-steps  and  possibly  the  use  of 
a  nonstiff  integrator.  This  has  been  demonstrated  for  a  very  small  sys¬ 
tem  of  marginal  interest. 

Near-Analytical  Integration 

Often  the  responses  of  process  variables,  such  as  temperatures  and 
compositions,  have  a  familiar  form,  approaching  exponential  variations, 
for  example.  In  these  cases,  it  may  be  possible  to  obtain  algebraic 
equations  that  contain  this  functionality  through  analytical  integration 
with  the  appropriate  numerical  approximations  and,  in  this  manner,  avoid 
numerical  integration  with  small  time-steps  in  tracking  these  fast  vari¬ 
ables. 

As  an  example,  consider  Xayihan's  model  for  reacting  po lydi spersed 
particles  which  he  illustrates  for  an  entrained  bed  reactor  to  devola- 
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tilize  coal  (1980) .  Figure  9  is  a  schematic  of  the  reactor  into  which 

a  slurry  of  pulverized  coal  in  carrier  gas  (at  temperature,  T  , 

Go 

gas  flow  rate,  G0,  and  mass  flow  rates  of  particles  in  K  discrete  size 

ranges,  m, ,...,m  )  is  mixed  with  hot  gas  (at  temperature,  T  ,  and  flow 
1  K  FO 

rate,  Fq).  As  the  coal  particles  move  through  the  reactor,  they  are 
heated  by  convection  and  devolatilization  occurs. 

The  model  assumes  a  uniform  density  and  heat  capacity  in  all  solid 
particles  and  uniform  heat  capacity  in  the  gas  phase.  The  energy  balance 
for  particles  in  each  size  range ,  j ,  is 


"j  cat  '  Sjh(TF  -  V  *  5T  [(C  -  c)Tj  +  aV 


where  T.  does  not  vary  with  particle  radius  and  a  .  is  the  area  for 
convective  heat  transfer.  It  is  assumed  that  N  first-order  reactions, 
i,  remove  the  volatile  species  from  each  size  range: 


dv,  , 

*  k  .  (v*  -  v.  ,)e  Ej/RTj  i»l,  . . .  ,n 

dt  01  1  13  j-l . K 


where  v*  is  the  maximum  volatiles  produced  by  reaction  i  in  grams  per 
gram  of  solid  initially  and  v„  is  related  to  nr  by  the  mass  balances 


m.  =  m  .(1  -  Z  v..) 
1  03  L  iJ 


3*1 , • • • , K 


For  devolatilization  of  Montana  lignite,  Kayihan  uses  kinetic  parameters 
of  Suuberg  (1977)  for  15  parallel  reactions  to  produce  8  volatile  spe¬ 


cies.  With  K  =  10,  Eqns .  (27)  -  (29)  give  160  ODEs  to  be  solved  with 


I 
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the  algebraic  mass  and  energy  balances  in  the  gas  phase.  The  particle 
temperatures  range  from  500°K  (for  the  larger  particles)  to  1000°K  and 
with  a  wide  range  of  reaction  rates  the  differential  equations  are  ex¬ 
pected  to  be  stiff.  Kayihan  estimates  a  stiffness  ratio  (111  / 1 X I  .  ) 

24 

equal  to  10  ,  but  this  is  a  poor  measure  of  stiffness. 

This  led  him  to  use  the  DVOGER  stiff  ODE  integration  routine  in  the 
XMSL  Library  (1977) ,  which  uses  the  GEAR  algorithm.  Hie  160  stiff  ODEs 
were  integrated,  using  analytical  expressions  for  the  Jacobian  elements, 
over  one-one  hundredth  of  the  residence  time  for  the  largest  particles 
and  projected  to  require  over  10  hours  on  a  CDC  CYBER  73  computer.  This 
was  primarily  due  to  the  excessive  operations  with  zero  elements  in  LU 
factorization  of  a  sparse  160  x  160  Jacobian  matrix  and  the  subsequent 
elimination  and  substitution  steps.  A  significant  reduction  in  operations 
would  be  expected  using  GEARS  with  its  routines  for  efficient  inversion 
of  sparse  matrices.  But,  Kayihan  did  not  use  this  generalized  algorithm. 

Instead,  he  integrated  Eqns.  (27)  and  (28)  analytically  with  nu¬ 
merical  approximations  and  obtained  algebraic  equations  that  preserve 
the  eiqponential  variations  in  temperature  and  conversion  with  time. 

The  energy  balances  for  particles  in  size  range  j,  Eqn.  (27)  are  re¬ 
written  : 

dT-i  dnu 

*iar*,i”F4,iar  1301 


where 
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m  c 

a.  *  .  0. 

3  a  .h  3 

S3 


(C  -  c)T.  +  AH_ 


An  integrating  factor,  expft/a^},  is  introduced: 


t/«j  e  3  dnu 

d(e  T  }  -  -j— (Tp  *  6  =1  )dt 


and  Eqn.  (31)  is  integrated  analytically  from  tR  to  t^  assuming 

T_  =  (T  +  T  )/2,  a  =  (a  +  a.  )/2,  6.  =  (0.  +  0.  )/2,  and 

F  Fn-1  Fn  3  2n  3  3n-1  3n 


n-1  n 


n-1  ■'n 


linear  variation  of  exp{t/a.}  with  t  to  give: 


-At/a .  At/a . 

T. (t  >  -  T.{t  }e  3  +  T_{t  }  [1  -  e  3] 
j  n  j  n-x  r  n 


0.  .  .  -At/a. 

£  ‘-jV1  -  h->  -  ■j<Viw  -  *r)e  3>  <32> 

3  J  3  3 


Similarly,  Eqns.  (28)  are  integrated  analytically: 


v.  .  *  v*  [1  -  e 
13  i 


,  f  -E./RTi  , 

-k  /  e  i  3  at 

01 
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or 


v.  . 


13 


-k  .  Z 

v* [1  -  e  01  m=l 


♦  .{t  } 
13  m  , 


(34) 


where 


♦  .  .(t  } 
13  m 


(35) 


and  Eqn.  (35)  is  integrated  assuming  linear  variation  of  T_.  between 

J 

t  .  and  t  .  The  resulting  algebraic  equations  are  solved  simultaneously 
nr- 1  m 

with  Eqns. (32) ,  and  the  mass  and  energy  balances  for  the  gas  phase  to 
compute  profiles  of  all  unknowns  in  time.  The  equations  are  decoupled 
with  guesses  for  the  profiles  of  particle  temperatures  to  avoid  opera¬ 
tions  with  large  sparse  matrices. 

Using  a  uniform  At  (■  0.01  t  ),  4-5  iterations  gave  three  sig- 

max 

nificant  figures  in  less  than  30  seconds  of  CDC  CYBER  73  computer  time. 
Whereas  the  stiff  integrator  is  very  convenient  to  use,  this  is  illus¬ 
trative  of  the  many  problems  for  which  physical  insights  lead  to  special¬ 
ized  algorithms  that  are  more  efficient,  in  some  cases  permitting  a  solu¬ 
tion  that  could  otherwise  not  be  obtained  with  available  computing  re¬ 
sources  . 

Application  of  Steady-state  Algorithms 

Many  models  involve  coupled  ordinary  differential  and  algebraic 
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equations  ,  with  the  ODEs  reducing  to  algebraic  equations  in  the  steady- 
state.  Since  steady  performance  is  the  usual  objective  for  continuous 
processing  systems,  an  extensive  collection  of  algorithms  has  been  de¬ 
veloped  for  design  and  evaluation  of  operating  strategies  in  the  steady- 
state.  These  often  solve  large  sets  of  algebraic  equations  using  spec¬ 
ialized  algorithms  that  incorporate  physical  insights  to  gain  efficiency. 

However,  when  the  GEAR  multi-step  algorithm  is  used  to  integrate 
stiff  ODEs 


dt  =  — {t'^  ' 


backward  difference  formulas: 


r-1 


(36) 


must  be  solved  for  during  each  time  step,  where  r  is  the  order  of 

accuracy  of  the  formulas.  Of  course,  these  nonlinear  algebraic  equa¬ 
tions  are  very  similar  to  the  steady-state  equations: 

f{£}  =0  (37) 

Hence,  they  can  be  solved  using  the  steady-state  algorithm  with  minor 
modifications.  The  GEAR  subroutine  STIFF  is  also  modified  to  transfer 


the  summation  term: 


i  V.-. 
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t 

S 

1 


and  the  step-size,  h,  and  8  to  the  modified  steady-state  algorithm, 
which  solves  the  entire  set  of  algebraic  equations  for  ^n+1  (and  the 
other  variables)  and  returns  to  the  GEAR  integrator. 

This  technique  was  introduced  for  distillation  towers  by  Boston 
and  coworkers  (1981).  They  used  the  GEAR  integrator  to  integrate  Eqn. 
(21),  the  energy  balance  (ignoring  the  sidestreams): 


M.  tLi+l(hi+l 
i 


v.  (hv  -  hL) 

ii  i 


(38) 


+  V 


i-1 


<hI-l  -  ht>  *  Vhi  '  hi>  + 


i*l, . . .  ,N 


and  the  overall  mass  balance  (ignoring  the  sidestreams) : 


dM. 
_ l 

dt 


Li+1 


+  V.  ,  +  F. 
1-1  l 


i»l, .  . .  ,N 


(39) 


These  equations  and  associated  algebraic  equations  are  derived  in  the 
Appendix.  Rather  than  allow  the  GEAR  algorithm  to  solve  Eqn.  (36) , 
with  the  algebraic  MESH  equations,  Boston  and  coworkers  prefer  to  use 
their  efficient  RADFRAC  program  with  modifications.  RADFRAC  solves 
the  MESH  equations  in  the  steady-state  using  the  Boston  and  Sullivan 
algorithm  (1974) .  This  algorithm  calculates  K-values  and  enthalpies 
accurately  in  an  outer  loop  only.  The  MESH  equations  are  solved  in 
the  inner  loop  using  approximate  models  for  K-values  and  enthalpies 


and,  roughly  speaking,  holding  relat'.ve  volatilities  constant.  Far 
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fewer  iterations  o£  the  outer  loop  are  necessary,  as  compared  with 
solution  using  a  Newton- Raphson  method,  and  hence  fewer  accurate 
evaluations  of  K-values  and  enthalpies  (very  time-consuming  calcula¬ 
tions  in  non-ideal  distillation  towers)  are  necessary. 


Model  Simplification 

In  some  of  the  previous  approaches  (e.g.,  near-analytical  in¬ 
tegration  and  application  of  steady-state  algorithms) ,  physical  attri¬ 
butes  of  the  processes  permit  us  to  improve  the  efficiency  and  relia¬ 
bility  of  the  numerical  methods  without  simplification  of  the  model. 

In  other  cases,  the  model  is  simplified;  for  example,  using  approxima¬ 
tions  for  dL/dt  in  distillation  when  it  is  not  necessary  to  accurately 
track  L  during  the  fast  transients  following  a  disturbance. 

It  is  occasionally  possible  to  simplify  a  model,  to  reduce  its 
stiffness,  and  permit  integration  with  a  nonstiff  integrator,  with  no 
loss  in  accuracy.  The  equations  of  Luss  and  Amundson  (1968),  Eqns.  (12) 
(15),  comprise  such  a  model.  As  noted  previously,  at  long  times  T  •+•  T 
and  pp  -*■  p,  with  decreasing  rates  of  change,  and  the  system  stiffens  be¬ 
cause  |l|ma>v  increases  with  stabilization.  When  the  temperatures  and 
partial  pressures  differ  by  less  than  1  percent,  stiffness  sets  in 


( | X I ^x  a  2187).  To  permit  efficient  integration  with  an  explicit  in¬ 
tegrator,  Luss  and  Amundson  set  T  *  T  and  p  =  p  and  add  Eqns.  (12) 

P  P 

and  (14)  and  Eqns.  (13)  and  (15),  giving  two  less-stiff  ODEs  (|x|  * 


1.242) , 
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(1  +  A)  =  P  -  P  -  H  Kkp  (40) 

dT  e  g 

dT 

(1  +  C)  —  *  T  -  T  +  H  (T  -  T)  +  H_FKkp  (41) 

aT  e  w  w  T 

which  are  integrated  with  a  step-size  increased  by  a  factor  of  100. 

SINGLE-STEP  AND  MULTI-STEP  ALGORITHMS  - 
ADVANTAGES  AND  DISADVANTAGES 

Much  of  the  recent  literature  places  emphasis  on  the  multi-step 
algorithms  using  the  backward  difference  formulas  popularized  by  Gear 
(1971)  and  Hindmarsh  (1974).  The  single-step  methods,  such  as  semi- 
implicit  Runge-Kutta,  receive  less  publicity,  probably  because  the  Ja¬ 
cobian  must  be  evaluated  accurately  during  each  time-step.  However, 
there  are  an  increasing  number  of  factors  that  favor  usage  of  single- 
step  methods,  and  collectively,  for  some  problems,  these  may  override 
the  factors  that  favor  the  multi-step  methods,  these  are  itemized  below: 

1.  A  new  adaptive  semi-inplicit  Runge-Kutta  algorithm  (Prokopakis 
and  Seider,  1981),  in  limited  testing,  appears  to  be  com¬ 
petitive  with  the  GEAR  program  (Hindmarsh,  1974) .  Larger 
time-steps  are  taken,  but  the  computation  time  per  step  is 
somewhat  larger,  mostly  due  to  more  frequent  evaluation  of 
the  Jacobian. 

2.  Storage  of  the  6xm  Nordsieck  array  (or  the  equivalent 

^-i-l''’*'^i  6^  avo^ec*  single-step  methods, 
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but  interpolation  for  printing  at  even  intervals  is  less 
accurate  -  sometimes  requiring  integration  with  a  reduced 
time-step. 

3.  The  semi-implicit  Runge-Kutta  (SIRK)  methods  are  A-stable 

and  the  adaptive  algorithm  adjusts  y^Cthe  characteristic 

root  as  h|Re{X}|  -*■•»)  as  a  function  of  hX  ,  where  X 
'  'max  s  s 

is  the  pseudo-eigenvalue  given  by 

dys  r 

IT  ’  Vs 

and  s  is  the  fastest  variable  or  "stiff"  variable,  y  is 

00 

adjusted  to  give  an  exact  solution  to  Eqn.  (40)  and  to  in¬ 
crease  the  accuracy  of  a  second-order  SIRK  formula  for  the 
system  of  ODEs.  When  hXg  is  large,  0  to  give  strong 

A-stability.  Whereas,  the  backward  difference  formulas  of 
order  one  to  five  are  just  "stiffly-stable"  and  can  be  un¬ 
stable  for  X  near  the  imaginary  axis. 

4.  For  the  serai-implicit  Runge-Kutta  methods,  step-size  adjust¬ 
ment  can  be  accorrplished  using  imbedded  formulas  for  estima¬ 
tion  of  truncation  errors  and  an  efficient  extrapolation 
method  (Prokopakis  and  Seider,  1981).  Whereas,  in  the  multi- 
step  methods,  the  step-size  and  order  of  methoJ  are  adjusted 


(42) 


simultaneously  and  according  to  Shampine  and  Gear  (1979) : 
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"While  the  basic  strategy  is  straightforward  -  the  two 
are  chosen  to  try  and  minimize  the  amount  of  work  done 
to  integrate  over  the  interval  -  the  implementation  is 
not.  The  problem  lies  in  the  fact  that  there  is  not  yet 
an  adequate  theory  to  tell  us  how  to  choose  these  para¬ 
meters  " . 

5.  Finally,  in  some  problems  it  is  desirable  to  ejqpand  or  con¬ 
tract  the  number  of  ODEs  in  time.  This  is  difficult  to  ac¬ 
complish  with  multi-step  methods  due  to  the  need  to  inter¬ 
polate  or  extrapolate  the  derivatives  of  the  Nordsieck  ar¬ 
ray.  whereas,  in  single-step  algorithms  no  historical  in¬ 
formation  need  be  updated. 

Many  of  these  advantages  may  not  override  two  key  advantages  of 
the  multistep  methods; 

1.  The  Jacobian  is  evaluated  less  frequently  and  need  not  be 
evaluated  accurately  as  it  is  only  used  to  solve  the  cor¬ 
rector  equations. 

2.  With  the  Nordsieck  array,  printing  at  even  intervals  is  accom¬ 
plished  routinely.  Single-step  methods  require  approximate 
interpolation  or  integration  with  a  smaller  tim*-step. 

Another  important  advantage  is : 

3.  Multi-step  methods  can  be  coupled  to  steady-state  algorithms 
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for  solution  of  the  algebraic  equations.  This  cannot  be 
accomplished,  to  our  knowledge,  with  single-step,  non-it¬ 
erative  methods. 

The  advantages  of  these  methods  should  be  weighed  for  each  system. 

APPENDIX 

This  Appendix  briefly  reviews  the  typical  model  for  the  dynamic 
simulation  of  a  distillation  tower.  More  details  are  given  by  Proko- 
pakis  and  Seider  (1982). 

The  usual  nomenclature  is  shown  in  Figure  10,  a  schematic  of  a  dis¬ 
tillation  tower,  where  the  general  Tray  i  has  a  feed  stream,  vapor  and 

v 

liquid  sidestreams,  and  heat  transfer.  Note  that  s^  is  the  fraction 
of  vapor  leaving  Tray  i  in  the  sidestream  and  s^  corresponds  for  the 
liquid  sidestream. 

The  usual  model  involves  the  following  assumptions: 

(1)  The  vapor  and  liquid  streams  leave  the  trays  at  equili¬ 
brium, 

(2)  the  liquid  on  each  tray  is  perfectly  mixed, 

(3)  the  vapor  hold-up  on  the  trays  is  negligible, 

(4)  the  transportation  delay  of  liquid  and  vapor  between 
trays  is  negligible,  and 

(5)  the  temperature  on  each  tray  is  uniform. 
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The  liquid  hold-up  on  Tray  i  is: 


M.  =  p.  {x. , T. ,  P .  }A.  (H  +  A  ) 
1  i  —l  i  1  1  w.  w. 

i  i 


i=l, . . . ,N 


(A5) 


where  A.  is  cross-sectional  area  of  Tray  i,  is  the  weir  height,  and 

i  wi 

AWi  is  the  crest  height  of  the  liquid  over  the  weir.  Ballard  and  Brosi- 
low  (.1978)  use  a  form  of  the  Francis  weir  formula  to  represent  the  tray 
hydraulics : 


Awi 


*  1.41 


L. 

X 


g  p  .  {x.  ,T.  ,P.  }lv. 
1  ~ 1  1  1  1 


2/3 


1—1 , . a . , N 


(A6) 


where  L  is  the  weir  length  and  g  the  acceleration  due  to  gravity. 
wi 

Whereas,  others  assume  that  AWi  is  independent  of  ,  p^,  and  ; 
that  is,  a  constant  volume  of  hold-up  exists  on  each  tray. 

In  addition,  the  mole  fractions  for  the  vapor  and  liquid  phases  on 
Tray  i  sum  to  unity: 


C  C 

Z  x. ,  =  Z  y. .  =  1  i=l,...,N  (A7) 

j-1  13  3-1  13 

There  are  N(C  +  2)  ODEs  (Eqns.  (Al) ,  (A2)  and  (A4) ,  and  N(C  +  4) 
algebraic  equations  ((A3),  (A5)  -  (A7) ;  hence,  N(C  +  5)  independent 
equations,  since  the  overall  mass  balances  depend  upon  the  remaining 


equations.  There  are  N(3C  +  15)  variables  and  N(C  +  10)  speci f i cat : 


' 
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with  an  appropriate  set:  W^^i'VVV^i'1*!'  i*l,...,N, 
and  j»l,...,C,  plus  Q^,  i*2,...,N-l,  s^,  i«l,...,N-l,  and  three  of  the 
variables,  reflux  ratio  (R  ■  (1  -  s^i/s**,  boil-up  ratio  (r'  *  V./L, ), 
bottoms  flow  rate  (L^) ,  boil-up  rate  (V^) ,  reboiler  heat  duty  (Q^) ,  or 
condenser  heat  duty  (Q^) •  Alternatively,  tray  pressures,  P^,  can  be 
computed  as  a  function  of  the  liquid  head  on  the  trays.  Note  that  when 
constant  volume  hold-up  is  assumed,  Eqn.  (A6)  and  the  variables  do 
not  apply;  is  specified  in  place  of  L^. 

Eqn.  (21)  is  derived  by  expanding  the  left-hand-side  of  Eqn.  (Al) . 
Eqn.  (A2)  is  multiplied  by  and  subtracted  from  Eqn.  (Al) .  Finally, 

the  vapor  mole  fractions,  y^,  are  eliminated  by  substitution  of  Eqn. 
(A3). 


Ballard  and  Brosilow  (1978)  combine  Eqns.  (Al),  (A2) ,  and  (A6)  to 


give: 


dL 

M  -  DL  +  EV  -  d* 
*L  dt  »—  —  -*» 


where  *  diagOM^/dL^}  and  0  and  E  are  bi diagonal  matrices.  It  is 
assumed  that  the  liquid  density  is  the  molal  average  of  the  densities 
of  the  pure  species.  Another  equation  is  derived  using  Eqns.  (A4)  and 
(A3)  to  give: 


BL  +  CV 


£-4 


where  B  and  C  are  bidiagonal  matrices.  Then,  combining  Eqns.  (A8)  and 
(A9),  they  obtain: 


at  -  St,  <8  -  £  i^+  SL  (I£  %  -  ^ 


Eqn. 


Eqn.  (38)  is  derived  by  expanding  the  left-hand-side  of  Eqn.  (A4). 

L 

(A2)  is  multiplied  by  and  subtracted  from  Eqn.  (A4) . 
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NOMENCLATURE 


he 

hg 

Hwi 

J 

» 

k 

ho 

K 


Kij 

H 

Ki 

m 

mj 


defined  in  Eqn.  (20) 

dimensionless  constants  in  Eqns.  (14)  and  (15) 

2 

surface  area  of  particle  in  size  range  j,  cm 

2 

active  cross-sectional  area  of  Tray  i,  m 

concert  :i  it  ion,  mol /It  heat  capacity  of  solid  particles, 
cal/g°K;  constant  in  Eqn.  (9) 

number  of  chemical  species;  heat  capacity  of  gas,  cal/g°K 

jth  eigenvector  of  Jacobian  matrix 

vectors  in  Eqns.  (21),  (A8) ,  and  (A9) 

activation  energy  for  reaction  i,  cal/mol 

function 

flow  rate  of  feed  to  Tray  i,  mol/s 

2 

acceleration  due  to  gravity,  m/a 

triangular  coefficient  matrix  for  species  j  in  Eqn.  (21) 

step-size;  enthalpy,  cal/mol;  convective  heat  transfer 
coef. ,  cal/s  cm2°K 

step-size  to  satisfy  the  local  truncation  error,  e 

step-size  to  satisfy  the  stability  bound  for  a  reference 
integrator  that  is  not  A- stable 

height  of  weir  on  Tray  i,  m 

Jacobian  matrix 

reaction  rate  constant 

pre-exponential  factor 

chemical  equilibrium  constant;  number  of  discrete  par¬ 
ticle  size  ranges 

vapor-liquid  equilibrium  constant  for  species  j  on  Tray  i 
liquid  flow  rate  from  Tray  i,  mol/s 
length  of  weir  on  Tray  i,  mol/s 
number  of  ODEs 

mass  flow  rate  of  particles  in  size  range  j,  g/s 
liquid  hold-up  on  Tray  i,  mol 
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n 

N 

NA 

NB 

P 

Qi 

r 

rn 

R 


si 

SR 

t 

T 


U 

V 

V* 


X 


xij 

y 

zij 


diag{  31^/91^} 

number  of  equally  spaced  intervals  in  x  (Eqn.  (17)); 
number  of  fast  variables 

number  of  trays;  number  of  gas-solid  reactions 
R  -  NB 


number  of  independent  reactions  taken  at  equilibrium 

Partial  pressure  of  reacting  species 

rate  of  heat  transfer  to  Tray  i,  cal/s 

order  of  accuracy;  intrinsic  rate  of  reaction,  mol/Jl's 

net  rate  of  reaction  (r.  -  r  ),  mol/l*s 

for  rev 

universal  gas  constant;  number  of  independent  chemical 
reactions 

(t_,  ,  -  t  )/t  . 

final  o  min 

fraction  of  stream  in  sidedraw  from  Tray  i 
stiffness  ratio,  |Re{A}|f|utv/|Re{l}|i|||4n 
time,  s 

temperature,  °K 

dimensionless  velocity  in  x- direction 

volatiles  produced  in  size  range  j  by  reaction  i,  g/g 

max.  volatiles  produced  by  reaction  i,  g/g  of  solid 
initially 

flow  rate  of  vapor  stream  from  Tray  i 
spatial  dimension 

mole  fraction  of  species  j  in  liquid  on  Tray  i 
dependent  variable 

mole  fraction  of  species  j  in  feed  stream  to  Tray  i 


Greek  Symbols 


0£,6-l 

Y« 

5 


Ax 


relative  volatility,  Kj/Rr 

parameters  in  GEAR  backward  difference  formulas 
characteristic  root  of  integration  formula  as  h | Re {A> |  -►  » 
real  stability  bound 
grid  spacing  in  x-direction 
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liquid  height  over  weir  on  Tray  i ,  m 
Z  linear  combination  of  concentrations  (Eqn.  (26)),  mol/1 

\  vector  of  m  eigenvalues 

Ts  pseudo- eigenvalue  for  stiff  variable,  Eqn.  (42) 

p£  density  of  liquid  on  Tray  i 

c  he/hs 

t  time  constant,  l/|Re{X}|;  dimensionless  time,  Eqn.  (13) 

V  dimensionless  viscosity 

$  defined  in  Eqn.  (20) 

(u  frequency  in  Eqn.  (9) 


Subscripts 

e 

F 

for 

i 

j 

n 

o 

P 

rev 

3 

W 


entrance 

feed 

forward 

time-step  counter;  tray  counter 

species  counter;  particle  size-range  counter 

time-step  counter 

initial 

particle 

reverse 

stiff  (or  fast)  variable 
wall 


Superscripts 

F  feed 

L  liquid 

o  initial 


v 


vapor 
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Table  1  Concentration  derivatives  and  eigenvalues  for  the  Belousov  reaction  system 
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Table  2  Concentration  derivatives  and  eigenvalues 


t,  hr 

for  the  atmospheric 
puted  using  LSODE*. 

ctyj/dt  dy2/dt 

reaction  system.  Com- 

X1  X2 

0 

-6.0315x10® 

6.0305x10® 

-6.031 

-9.319x10“ 10 

1 

2.324X10-4 

-2.595X10-4 

-6.031 

=0 

_  -11 

2 

79.331 

-117.94 

-6.031 

-7.723x10 

4 

9.495X103 

3.022xl05 

-6.032 

-4.773xl0”8 

6 

9. 178x10 2 

1.102xl0? 

-6.032 

-1.622xl0~7 

8 

-1.021xl04 

3.180X105 

-6.032 

-5.140x10"® 

-11 

10 

-85.518 

40.671 

-6.032 

-8.324x10 

12 

“0 

“0 

-6.032 

*0 

18 

*0 

a0 

-6.032 

“0 

24 

=0 

*0 

-6.032 

»0 

30 

9.115X102 

l.lOlxlO7 

-6.032 

-1.741xl0"7 

42 

StQ 

»0 

-6.032 

“0 

*  Relative  error  tolerance  *  10_45 
Absolute  error  tolerance  *  10 
UNIVAC  1100  -  Double  precision 
Values  30  are  <10“17 


Table  3 


Eigenvalues  of  ODEs  from  discretization 
of  the  spatial  derivative  in  the  diffu¬ 
sion  equation. 


a 


n 

min 

|X| 

1  1  max 

Stiffness 

2 

9.00 

27.00 

3 

3 

9.37 

54.62 

5.8 

5 

9.65 

134.34 

13.9 

7 

9.74 

246.23 

25.3 

9 

9.79 

390.18 

39.9 

11 

9.81 

566.14 

57.7 

13 

9.83 

774.11 

78.8 

15 

9.84 

1013.8 

103 

Table  4 

Eigenvalues 

for  momentum  balance  with 

viscous  dissipation+ 

Dimensionless 
viscosity, u 

t 

!»•<»>  U, 

| Re{A}  | 

1  'max 

0.003* 

0 

0.937 

224 

0.2 

0.964 

238 

0.5 

1.04 

254 

1.0 

2.65 

263 

0.03 

0 

0.721 

1.69x10* 

0.2 

0.900 

1.71x1011 

0.5 

1.44 

1.72x1011 

1.0 

5.39 

1. 72x10 J 

0.3 

0 

3.07 

1.61xlo1 

0.2 

3.08 

1.61x10* 

0.5 

3.12 

1.61x10* 

1.61x10 

1.0 

3.18 

Most  eigenvalues  are  complex  i 


+  All  eigenvalues  have  a  negative  real  part 


Table  5  Time-steps  for  dehydration  of  isopropanol  using  the  ASIRK  integration 

algorithm  (Prakopakis  and  Seider,  1981)  .  Thermophysical  property 
data  are  given  by  Prokopakis  and  coworkers  (1981). 
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Numerical  Integration  of  Stiff  Differential/Algebraic  Equations 

with  Severe  Discontinuities _ 


T.  S.  Chua 
P.  M.  Dew 

Department  of  Computer  Studies 
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LEEDS  LS2  9JT 


The  simulation  of  industrial  processes  often  involves  the 
numerical  solution  of  a  system  of  initial  valued,  stiff 
differential/algebraic  equations  (DAE)  with  severe  discontinuities 
in  the  derivative  of  its  solution.  On  problems  of  this  type  a 
standard  variable-step  integrator  is  either  very  inefficient  or 
fails  to  compute  the  solution. 

The  purpose  of  this  paper  is  to  describe  a  restart  strategy 
which  can  be  used  to  improve  the  efficiency  of  a  variable-step 
stiff  integrator  and  present  a  case  for  its  inclusion  in  a 
general-purpose  stiff  solver.  The  paper  will  also  discuss  the 
design  of  an  efficient  variable-step  solver  for  a  DAE  system  based 
on  the  work  of  PetzoldC13.  The  design  and  use  of  the  restart 
strategy  for  a  DAE  system  arising  from  the  simulation  of  British 
Gas  transmission  networks  is  given  in  Chua  and  Dew[23;  this 
paper  put  this  work  into  a  more  general  framework. 

The  general  parabolic  DAE  system  considered  is 

E  -  f  <t,*>  (1) 

where  the  matrix  E  is  singular  if  there  are  algebraic  equations 
present  in  the  system.  The  general  strategy  employed  is  to  use 
normal  variable-step  integration  everywhere  except  immediately 
after  a  discontinuity  has  occurred  when  a  restart  phase  is  indicated. 
(The  discontinuity  is  detected  using  a  supplied  function  which 
changes  sign  over  the  discon tiniuty) .  During  the  restart  phase, 
the  local  error  control  is  suspended  which  enables  a  larger  time  step 
to  be  used  than  would  otherwise  be  the  case.  The  timestep  is  kept 
constant  during  this  phase  until  the  estimate  of  the  global  error 
indicates  that  it  is  safe  to  return  to  normal  variable-step 
integration.  Extensive  numerical  testing  on  Gas  transmission  problems  has 
shown  that  the  restart  strategy  is  extremely  robust  and  considerably 
reduces  the  amount  of  computation. 

The  variable-step  integrator  described  in  the  paper  is  based  on 
a  2-stage  2nd  order,  L-stable  Rosen brock- type  method  (ScratonC 33) . 

The  numerical  performances  of  the  integrator  is  illustrated  using  a 
heat  conduction  equation  with  discontinuous  boundary  conditions  and 
a  large  scale  British  Gas  transmission  network  simulation. 
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ABSTRACT 


It  Is  shown  here  that  the  rate  equations  for  a  first  order  chain 
branched  reaction  modelling  the  combustion  of  hydrogen  can  be  approximated 
by  a  solvable  canonical  problem.  We  call  this  the  explosion  mode  approxi¬ 
mation  to  the  problem.  We  say  that  there  is  an  explosion  if  branching 
reactions  initially  dominate  termination  reactions.  A  dimensionless 
parameter  E  Is  Introduced  which  provides  a  quantitative  criterion  for  an 
explosion  to  occur;  for  E  >  0  there  is  an  explosion,  for  E  <  0  there 
is  not.  We  construct  approximations  to  the  explosion  kinetics  when  E  >  0, 
and  present  numerical  simulations  to  illustrate  several  cases. 


1.  A  CANONICAL  FIRST  OROER  CHAIN  BRANCHED  REACTION 


The  reaction  studied  In  this  section  Illustrates  the  basic  calculations 
needed  for  our  explosion  mode  analysis  of  the  combustion  of  hydrogen.  The 
reaction  Is  summarized  In  Table  1. 

We  denote  by  [A]  the  concentration  of  chemical  species  A,  and  we  set 
u  *  [A]  and  x  =  [B] . 

The  kinetic  rate  equations  which  describe  this  reaction  are 

u  *  -kux  -  kQu  ,  u(0)  a  uQ 

2 

x  *  kux  -  ax  +  kQu  ,  x(0)  *  0, 

where  •  *  d/dt.  The  analysis  of  this  problem  breaks  down  Into  three  parts 
which  reflect  the  three  stages  of  the  reaction. 

Initiation:  x  -  0. 

In  the  Initial  stages,  the  kinetics  are  described  by  the  equations 

u  *  -kgU2,  x  *  kpU2 

Thus,  u  *  UQ/(u0kgt+l)  and  x  *  uQ  -  u. 

2 

Branching:  kux  -  ax  »  kQu  . 

If  kuQ  >  a,  then  [B]  will  grow  due  to  the  branching  reaction  dominating 
termination.  The  model  now  becomes 
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u  =  -kux,  x  *  (ku-a)x. 

This  problem  can  be  solved  explicitly: 

x  =  (|-)ln(u/u)  -  u  +  u  +  x 

where  0,  X  are  values  of  [A]  and  [B]  after  the  initiation  phase  of  the 
reaction.  In  fact,  the  initiation  and  branching  phases  are  adequately 
approximated  by  taking 

x  *  |  ln(u/u0)  +  u0  -  u. 

This  approximation  is  valid  throughout  the  remainder  of  the  reaction. 
The  initiation  reaction  plays  no  further  significant  role  since  at  the 
maximum  of  x,  u  rapidly  approaches  a  quasi-static  state  (u  *  0),  after 
which  the  termination  reaction  dominates: 


combustion  are 


u  ~  0,  X  *  -ax. 

Parameters  analogous  to  those  of  hydrogen 


uQ  =  IE-8,  kQ  *  1E2,  k  »  1  Ell ,  a  =  1E2,  xQ  =  0. 

-8 

Here  the  notation  IE-8  denotes  1  x  10  ,  etc. 

Reactions  of  this  kind  have  been  studied  earlier  [1-3].  In  the  next 
section,  we  show  how  this  analysis  can  be  applied  to  study  the  combustion 
of  hydrogen. 

2.  AN  H2-02  REACTION 

The  reaction  studied  here  is  described  in  Table  2.  This  breaks  down 
into  three  types  of  elementary  reactions:  initiation,  branching  and 


propagation,  and  termination.  In  these  reactions,  H02  is  taken  to  be  an 
inactive  particle  [1,3]  and  VI  in  the  termination  reactions  indicates  collision 
with  the  container's  wall. 

We  set 


u  *  CH2],  v  =  [02],  x  =  [H-],  y  ■  [0H-],  z  =  [0*]. 
Then,  the  kinetic  rate  equations  are 


u  * 

-(y  + 

k3z)u  -  kQuv, 

u(0) 

=  ui 

*  = 

-(k2x)v 

-  kQuv, 

v(0) 

=  vi 

X  * 

-(k2v  + 

a2)x  +  (k1u)y  + 

(k3u)z  +  kguv. 

x(0) 

=  0 

y  = 

(k2v)x  - 

■  (k^u  +  a-j)y  + 

(k3u)z. 

y(o) 

=  0 

i  * 

(k2v)x 

-  (k3u  +  a3)z. 

z(0) 

=  0 

where  a^  =  ajw,  i  *  1,  2,  3,  denote  the  pseudo  first  order  rate  constants 
for  the  termination  reaction  (w  remains  constant  throughout  these 
reactions).  It  is  convenient  to  rewrite  this  system  in  matrix  form 


_d_ 

dt 


u 

V 


-(y +  k3z)  0  ' 

f  > 

u 

1 

-knuv 

0  -k2x 

^  4 

.V 

u 

X 

X 

X 

m 

y 

w 

*  (B-T) 

y 

[zj 

+  k0u» 

o  o' 

The  matrix  B  describes  the  branching  reactions,  and  it  is  of  the  form 


•a  By 
a  -B  y 
a  0  "YJ 


,  where  a  =  k2v,  6  =  k-jU  and  y  *  k^u. 


The  matrix  T,  which  describes  the  termination  reactions,  is 
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a1  0  0 

T  *  0  a2  0 

0  0  a3  * 

kQ  *  0.  Ignoring  for  the  moment  the  Initiation  reaction,  we  see  that 
initially  (i.e.,  at  t  =  0  where  u  *  uQ,  v  *  vQ,  x  a  y  *  z  *  0),  the  rate 
equations  have  the  form 

X  X 

*  -  *  *  o.  *  <80-T)  *  • 

where  BQ  denotes  B  evaluated  at  u  s  uQ,  v  =  vQ.  If  the  matrix  BQ-T 
has  a  positive  eigenvalue,  then  once  initiated,  the  branching  reactions 
dominate  termination,  and  the  vector  of  radical  components  (i.e.,  x,  y,  z) 
has  a  growing  mode.  We  base  our  definition  of  an  explosion  on  this  fact. 
Namely,  we  say  that  an  explosion  will  occur  if  branching  initially  dominates 
termination,  or  equivalently  If  BQ-T  has  a  positive  eigenvalue.  We  define 
the  explosion  number  to  be  the  dimensionless  quantity 

E  =  det(B0-T)r3 

where  t  has  the  dimensions  of  time  used  to  measure  the  kinetic  rates.  We 
show  next  that  E  >  0  implies  an  explosion  occurs,  E  <  0  implies  no 
explosion  occurs. 

3.  EXPLOSION  MODE  ANALYSIS: 

a.  Spectral  Analysis  of  B-T. 

We  begin  with  the  characteristic  polynomial  of  B-T: 


P(A)  «  -det(B-T-\I3) 
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whose  roots  are  the  eigenvalues  of  B-T.  Here  I3  denotes  the  3  *  3-identity 
matrix.  P  has  the  form 

P(X)  *  X3  +  aX2  +  uX  -  6(u,v) 


where 

a3at+8+Y+a}+a2  +  a3>0» 
u  3  a(a2+a3)  +  8(Y+a1+a3)  +  Yfaj+ag)  +  a^  +  a2a3  +  a^  >  0 
and 


6  (u,v)  *  2aBY  -  {a-|0Y  +  aia2Y  +  a]a36  +  a2a3“  +  ala2a3^'  (2) 

Note  that  5(u,v)  3  det(B-T).  The  sign  of  6  plays  an  important  role  here. 
First,  P  is  monotone  increasing  for  X  >  0.  In  fact 

^  *  3X2  +  2oX  +  y  >  0  for  X  >  0. 

Therefore,  if  P(0)  3  -5(u,v)  <  0,  then  there  is  a  unique  real,  positive 

eigenvalue  X*(u,v).  Moreover,  if  x^  and  X2  denote  the  other  two  eigen¬ 
values,  then  either  (a)  they  are  real  and  both  are  negative,  or  (b)  they 

are  imaginary  (i.e.,  X^  *  X2).  In  the  last  case  X*  +  X^  +  X-j  3  -a  <  0, 

so  2  Re  X-j  <  -  X*  <  0.  Thus,  in  either  case,  if  6(u,v)  >  0,  then  B-T  has 
one  positive,  real  eigenvalue  and  two  other  eigenvalues  having  negative  real 
parts. 

We  denote  by  X*(u,v)  the  eigenvalue  of  B-T  that  has  largest  (i.e., 
right  most)  real  part.  We  have  just  seen  that  if  5(u,v)  >  0,  then 
X*(u,v)  >  0.  Let  denote  the  corresponding  eigenvector;  i.e.. 


(B-T)4>*  3 
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and  let  -f*  denote  the  corresponding  adjoint  eigenvector;  i.e., 

(B-T)tr  ip*  = 

These  are  normalized  so  that 


\p*  .  a  i  and  *  1 . 

The  components  of  <j>*  are  denoted  by  <^,  <p |,  <{>|,  etc.,  and  the  notation 
<P*  •  <p*  denotes  the  usual  dot  product  of  vectors:  <t>*  •  <p*  * 

♦f  <Pf  +  etc. 

Thus,  X*(ug,v0)  >  0  If  and  only  if  <5(ug,Vg)  >0  (I.e. ,  E  >  0),  so 
an  explosion  occurs  according  to  our  definition.  If  E  <  0,  then 
X*(ug,Vg)  <  0,  and  no  explosion  occurs  since  termination  reactions  dominate. 

b.  Explosion  Mode  Decomposition 

When  6(uq,Vq)  >  0,  we  refer  to  <j>*  as  the  explosion  (or  branching) 
mode  since  It  gives  the  combination  of  radical  concentrations  which  will  grow 
initially  with  amplification  rate  X*(ug,Vg). 

Any  combination  of  radical  concentrations  can  be  written  as 


'  * 

X 

Explosion 

y  =  C$*  +  8 

Mode 

.2 

Decomposition 

where  the  scalar  c,  called  the  explosion  mode  amplitude,  is  defined  by 


\ 

X 

c  -  i|>*  •  y  ; 

x 

e 

x 

and  8  s  y  -  c<p*  satisfies  ip*  •  Q  s  0.  Moreover,  in  the  absence  of 
z 

initiation,  the  components  of  8  are  (strongly)  damped  since  8  is  carried 
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s 

t 

is 

1 


by  modes  corresponding  to  eigenvalues  of  B>T  having  negative  real  parts. 

x 

Therefore,  we  ignore  a,  substitute  y  *  c<|>*  into  the  equations  (1)  and 

U 

project  the  radical  equations  onto  the  explosion  mode  <f>*  (i.e.,  we  apply 
ip  *•  to  both  sides  of  the  radical  equations).  The  result  it 

Ci  *  +  k^>|)cu  -  kQuv 

♦  s  -(k^cv  -  kQuv 

t  *  X*(u,v)c  +  kQuv(J>f  -  0*  •  (4>*(u,v)), 

which  is  a  system  of  equations  for  the  fuel,  oxidant  and  explosion  mode 
amplitude. 

c.  Some  remarks  on  the  analysis  of  this  system. 


Several  remarks  must  be  made  at  this  point.  First,  if  ^  *  0, 
then  the  initiation  reaction  will  not  excite  the  branching  mode  of  the 
reaction.  Thus,  no  explosion  will  occur  even  though  6(u0,vQ)  >  0.  There¬ 
fore,  the  size  of  tj/f  must  be  accounted  for  in  calculating  the  initiation 
phase  of  the  reaction.  In  most  of  the  reactions  we  have  considered  in 
detail,  the  initiation  reaction  has  been  mostly  in  the  direction  of 
(i.e.,  *  1).  Next,  the  final  term  in  the  t  equation  must  be  avluated. 

Note  that  if  some  stoichiometric  relation  between  u  and  v  exists,  say 


v  «  u,  and  a-j  *  a2  »  a3  *  a, 
(independent  of  u  and  v). 


then  X*(u,v)  *  u  and  <J>*  is  constant 


This  term  has  the  form 


_ +  _L 

XrX*  X2-X 


where 


a  and  b  are  proportional  to  0  and  Thus,  if  I X ^ |  »  1  or  |u|, 
|$|  «  1,  then  this  term  is  negligible.  In  general,  if  \p*  •  =  0,  then 


the  last  term  in  this  equation  for  fc  vanishes,  and  a  completely  solvable 


system  results  to  describe  the  branching  phase  of  the  reaction.  In  particular, 


8 


If  <p*  •  »  0,  and  the  initiation  reaction  is  Ignored,  then 

0  •  -cu(kl(f|  +  k3<(»|) 

*  -  -cv(k^f) 
t  a  A*(u,v)c. 


This  system  can  be  solved  In  the  following  way:  The  first  two  equations  show 
that 


where 


Therefore,  v  »  ku^  where  k  Is  a  constant.  Next 


&  * 

Therefore 

c 

which  describes  the  explosion  mode's  amplitude  starting  from  post  Initiation 
concentrations  (0,2). 

We  describe  a  composite  approximation  to  the  reaction  kinetics  In  the 
next  section. 


,.1*  X*fu'  .ku'^du' 
Ju  <kl*2*k3*3>u 


A*(u,kJ) 

<l«(i|  +  k3^|] 


4.  EXPLOSION  KINETICS 

Let  us  suppose  that  the  Initial  concentrations  of  fuel  (uq)  and 
oxidant  (vQ)  are  sufficient  so  that  <5(uq,Vq)  >  As  In  the  canonical 
problem,  the  reaction  breaks  down  Into  three  phases.  Initiation,  explosion 
and  termination. 


Initiation:  x,  y,  z  «  u,  v. 


At  the  start  of  the  reaction,  the  radical  concentrations  are  small,  and 
the  rate  equations  become 


ft  ■  *  a  -kQuv,  *  u0’  *  v0 

t  *  kQuv 

These  equations  can  be  solved  explicitly:  Since  Q  *  v, 

u  -  v  -  vQ  +  uQ. 


Therefore, 


u(t) 


V 


k0(u0‘v0)t: 


1  + 


,-.ko(uo-''o»‘l 


vo  ■  u0 


c(t)  *  i|>f(u0-u(t)). 


This  approximation  is  valid  as  long  as 


X*(u,v)c  «  k0uv. 

Explosion:  kQ  *  0,  \p*  •  ^  <p*  •  0. 

This  phase  describes  the  branching  of  the  radicals.  Since  £2  is  small 

/ 

(at  most  order  kQUQV0),  and  it  does  not  grow  in  time,  we  ignore  £1  terms, 
and  arrive  at  the  canonical  problem 


0  -  -(k^|  +  k3$J)cu 


whose  solution  was  described  In  the  last  section.  This  approximation  remains 
valid  as  long  as  ip*  •  0*  However,  when  c  Is  large,  u  and  v 

can  change  rapidly,  and  so  0*  Is  expected  to  change. 

Termination:  k^c  »  1. 

In  this  A*(u,v)  ~  0,  but  the  fuel  (u)  and  oxidant  (v)  are  driven 
rapidly  to  the  static  state:  u  *  0,  v  »  0.  As  a  consequence,  c  decays 
through  the  termination  reactions;  thus 

4  *  A*(0,0)c. 


Composite  solution. 

A  detailed  matching  procedure  can  be  formulated  to  combine  these  approxi¬ 
mations  of  various  phases  of  the  reaction  Into  a  composite  approximation  to 
the  kinetics.  However,  the  portion  of  the  solution  which  carries  the  most 
Important  Information  Is  In  the  initiation  and  explosion  phases,  and  for 
typical  parameter  values  these  two  phases  can  be  approximated  by 


v  «  u 


c 


A*(0,k0)  dG 

<lc1»j  Vl3*|)  T  ' 


(4) 


This  approximation  Is  (roughly) valid  until  the  turning  point  Is  reached 
(I.e.,  X*(u,  ku)  *  0).  It  Is  Illustrated  in  several  numerical  examples 
presented  In  the  next  section. 


5.  NUMERICAL  SIMULATION  OF  THE  Hg-Og  REACTION. 


Me  present  here  several  Illustrative  calculations  using  typical  reaction 


rates  listed  by  Semenov  (1959).  These  are  based  on  a  version  of  Gear's 


package  [4]  and  the  EISPACK  package  [5]  for  finding  eigenvectors  and 
eigenvalues  of  matrices,  (s**  4) 


6.  DISCUSSION 


The  explosion  mode  method  of  analysis  presented  here  clarifies  the 
mechanisms  of  Hg-Og  explosions.  In  particular.  It  gives  a  quantitative 
criterion  (6  ■  0)  for  determining  when  Initial  concentrations  of  fuel  and 
oxidant  are  sufficient  to  sustain  an  explosion.  These  remarks  are  based  on 
our  definition  of  explosion:  An  explosion  occurs  when  branching  Initially 
dominates  termination. 

The  formula  (4)  Is  taken  here  as  a  good  approximation  to  the  solution 
up  to  the  turning  point.  In  fact.  If  we  take  X*  to  be  constant  In  (4), 
then  we  have 


c  .  3  OT+nOf  in^uV  ^ 

turning  1*2  3*3  0 

point 

where  c  and  u  are  the  values  of  c  and  u  at  the  turning  point.  Table 
3  shows  a  comparison  of  these  values  with  those  obtained  from  the  simulations. 
The  numerical  evidence  presented  here  supports  this  approximation  technique. 

We  have  also  found  this  approach  to  be  useful  In  studying  the  Hg-Air 
combustion  reaction.  In  that  case  there  are  for  certain  parameter  values, 
two  explosion  and  two  damped  modes,  so  that  the  analysis  becomes  more  Intricate. 
Note  that  in  applying  the  method  to  other  problems,  the  branching  termination 
matrix  B-T  can  be  easily  Identified  by  writing  the  rate  equations  in  the 
linear  form  indicated  in  (1)  and  then  evaluating  the  coefficient  matrix  at 
the  initial  concentration  levels.  In  the  case  of  the  Hg-Og  reaction,  this 
matri  x  i  s  (k\v  °t)  . 


[•] 
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There  are  no  significant  numerical  problems  in  solving  these  equations 
on  a  computer.  However,  there  is  an  Interesting  numerical  analysis  aspect 
to  the  explosion  mode  analysis.  What  stiffness  there  is  in  the  problem  is 
due  to  the  eigenvalues  of  B-T  which  have  negative  real  parts.  These  are 
sumnarlzed  for  the  five  simulations  In  Table  .  As  stated,  earlier  Gear's 
package  had  no  trouble  solving  these  problems.  However,  the  explosion  mode 
projection  is  actually  a  projection  onto  a  subdominant  mode,  and  so  avoids 
what  stiffness  there  Is.  To  Implement  this  scheme  numerically,  computational 
effort  must  be  Invested  In  evaluating  the  spectrum  of  B-T,  and  then  solving 
the  resulting  canonical  problem. 


Research  supported,  in  part  by  the  Department  of  Energy  Grant  § 29284 , 
Computations  were  carried  out  in  the  Applied  Mathematics  Computing  Laboratory 
at  the  University  of  Utah. 


TABLE  1 


REACTION 

A  +  A  -*>  B  +  P 
A  +  B  -*■  2B 
B  -*•  C 


CANONICAL  REACTION  DESCRIPTION 
RATE  CONSTANT 

kO 

k 

a 


TYPE  OF  REACTION 


Initiation 
Branchi ng 
Termination 


TABLE  2 


h2-o2  ELEMENTARY  REACTIONS 


REACTION 

RATE 

TYPE  OF  REACTION 

H2  +  02-«.  H*  +  H02 

ko 

Initiation 

Hg  ♦  OH*  H-  +  H20 

kl 

Og  +  H---*-  OH-  +  0* 

CM 

-X 

H2  +  0- — H-  +  OH* 

k3 

Propagation 

OH-  +  W  — 

*1 

H-  +  U  -** 

a2 

O-  +  W 


Termination 


a 

t 


n 


X 


Simulation  1.  Low  initial  concentrations,  slow  quenching. 


u 

o 

60,  k1 

=  2.3E11, 

k2  *  4.02E9,  k3  = 

2.82E12 

a1  *  92, 

a2  =  8* 

a3=  92 

u0  *  1 ,E-8»  vQ  = 

•5E-8. 

T(Secs) 

Hi 

^2 

iL 

OH- 

41 

0 

l.E-8 

•  5E-8 

0 

0 

0 

30 

(1.. 

2E-2,  7E-4) 

.01  ' 

l.E-8 

.5E-8 

3E-17 

5E-19 

2E-20 

30 

II 

.1 

IE-8 

.  5E-8 

1.5E-15 

2.5E-17 

IE-18 

30 

II 

.2 

IE-8 

.  5E-8 

3E-14 

5E-16 

2E-17 

30 

II 

.3 

1 E-8 

•  5E-8 

IE-12 

2E-14 

8E-16 

30 

II 

.4 

IE-8 

•  5E-8 

1.3E-11 

2.1E-13 

9E-15 

30 

II 

.5 

.  96E-8 

.48E-8 

2.3E-10 

3.8E-12 

1.6E-13 

29 

II 

.6 

.35E-8 

.27E-8 

. 29E-8 

.7E-10 

•3E-11 

11 

II 

.65 

.4E-9 

.14E-8 

.35E-8 

.2E-9 

•2E-10 

-3.1 

(1. 

,  5E-2,  3E-3) 

.7 

•3E-14 

•8E-9 

.2E-8 

- 1 E-9 

. 9E-10 

-11 

(1, 

4E-2,  4E-2) 

.8 

•3E-20 

.  5E-9 

.73-9 

•  2E-10 

.2E-10 

-10 

(1. 

.02,  .02) 

Simulation  2.  Low  initial  concentrations,  fast  quenching  (E  0) 


ki  as  in  Simulation  1. 


a1  *  920, 

=  80,  a^  3 

920 

T 

Hi 

°2  Ml 

OH-  Oi 

A * 

$1 

0 

IE-8 

.5E-8  0 

0  0 

-52 

(1. 

.01,  7.E-4) 

1E5 

•  9E-8 

.46E-8  . 5E-16 

. 6E-18  . 3E-19 

-54 

(1, 

.01,  .7E-4) 

Changes  in  all  components  are  monotonic. 


Simulation  3.  Moderate  initial  conditions,  slow  quenching 


(6(u0,V0) 

>  0) 

T 

h 

h 

±_ 

OH- 

hi 

0 

l.E-7 

.5E-7 

0 

0 

0 

390 

(1., 

.02, 

7.E-4) 

.01 

1 E-7 

•  5E-7 

.6E-13 

IE-15 

.4E-16 

390 

II 

.02 

IE-7 

.5E-7 

.2E-11 

•4E-13 

.2E-14 

390 

II 

.03 

1  E-7 

.  5E-7 

•6E-10 

.iE-n 

.4E-13 

380 

II 

.04 

. 94E-7 

.48E-7 

.4E-8 

.7E-10 

.3E-11 

370 

II 

.05 

.  1  E-7 

.2E-7 

.6E-7 

.25E-8 

.  1 E-9 

140 

(1., 

.05, 

2.E-3) 

.051 

.9E-9 

.  1  E-7 

.6E-7 

.6E-8 

.7E-9 

53 

(.95, 

.3, 

.02) 

.52 

.2E-11 

.  1  E-7 

.6E-7 

•  9E-8 

.3E-8 

-48 

(.6, 

.6, 

.5) 

In  this 

case  the  turning  point 

(X*  =  0) 

occurs 

at  time 

T  *  .515. 

At  this  value 

!,  <J>*  = 

{ .8,  .6, 

.1).  Thus,  i 

'•emaining  approximately  constant 

up  to  the  turning  point  of  the  reaction,  and  then  changes  significantly 
thereafter,  due  to  rapid  changes  in  [H^]. 


Simulation  4.  Moderate  Initial  conditions,  fast  quenching 

(S(u0,v0)  >  0 


al 

*  920, 

a2  *  80, 

a3  -  920 

T 

52 

52 

Ml 

OH- 

Mi 

^lU|Vl 

<fr» 

0 

.IE-6 

.  5E-7 

0 

0 

0 

300 

(l.f  .02,  7E-4) 

.01 

.IE-6 

.5E-7 

.3E-13 

.4E-15 

.2E-16 

300 

H 

.02 

.IE-6 

.5E-7 

. 6E-1 2 

•IE-13 

•4E-15 

300 

II 

.03 

.IE-6 

.5E-7 

.6E-11 

.IE-12 

. 5E-14 

300 

II 

.05 

•  IE-6 

.5E-7 

.2E-9 

-4E-11 

•2E-12 

300 

II 

.05 

.96E-7 

.49E-7 

.7E-9 

.4E-10 

•2E-11 

290 

II 

.06 

.4E-7 

.3E-7 

.3E-7 

•  7E-9 

.3E-10 

120 

(1.,  .02,  .001) 

.07 

.3E-13 

.8E-8 

.2E-7 

.  1 E-8 

•  9E-9 

-110 

(1.,  .04,  .04) 

.08 

.3E-19 

.5E-8 

.7E-8 

.2E-9 

.2E-9 

-98 

II 

Simulation  5.  High  Initial  concentrations,  slow  quenching 


(6  »  0) 


al 

=  92, 

a2  a  8, 

a3a  92 

T 

Ml 

OH 

0j_ 

\* 

£1 

0 

.IE-5 

•  5E-6 

0 

0 

0 

3.9E3 

(1.,  .02,  7E-4) 

.001 

.IE-5 

•  5E-6 

.3E-12 

.6E-14 

.2E-15 

3.9E3 

11 

.002 

•  IE-5 

.5E-6 

.3E-10 

.5E-12 

-2E-13 

3.9E3 

II 

.003 

.IE-5 

.5E-6 

.9E-9 

.2E-10 

.6E-12 

3.9E3 

II 

.004 

.9E-6 

.47E-6 

•  5E-7 

.9E-9 

•4E-10 

3.7E3 

II 

.005 

•  IE-7 

.IE-6 

.6E-6 

.6E-7 

.7E-8 

850 

(.96,  .28,  .01) 

.0051 

.6E-10 

.IE-6 

.  6E-6 

.9E-7 

.3E-7 

-17 

(.1,  .97,  .2) 

.00525 

E-22 

•8E-7 

.6E-6 

.IE-6 

•  7E-7 

-9.2 

(0,  .99,  .2) 

This  calculation  again  Illustrates  that  may  change  rapidly  near 


the  turning  point 
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Abstract:  We  review  computational  methods  for  approximating  the  highly  oscillatory 
problem  which  utilize  a  functional  of  the  solution  such  as  its  smooth  part  as  a  mean¬ 
ingful  solution  description.  We  review  highly  oscillatory  recurrences  by  the  two-time 
technique  and  give  several  applications.  Then  the  highly  oscillatory  ordinary  differen¬ 
tial  equation  is  treated  by  three  methods:  the  two-time  method,  an  extrapolation 
method  and  finally  an  averaging  method.  The  last  treatment  is  accompanied  by 
illustrative  computations. 


1.  Introduction 


The  highly  oscillatory  problem  is  particularly  difficult  since  the  rapidly  changing 
behavior  of  the  solution  is  an  ever  present  feature  and  not  a  transient  phase  to  be 
gotten  through.  Thus  most  approaches  to  the  highly  oscillatory  problem  abandon  the 
customary  procedure  of  approximating  the  solution  pointwise  (at  least  on  a  mesh). 
Instead  some  functional  of  the  solution  such  as  its  "smooth  part”  or  some  "running 
mean"  is  accepted  as  a  meaningful  description  and  it  is  this  functional  which  is 
approximated  through  computation.  This  overview  will  deal  with  several  methods 
which  take  this  approach.  (For  methods  with  the  classical  pointwise  approach  see  [1] 
and  [12].) 

We  begin  this  review  with  highly  oscillatory  recurrences  since  there  are  many  applica¬ 
tions  for  them,  several  of  which  are  reviewed  here.  These  recurrences  are  treated  by 
the  two-time  technique.  We  then  turn  to  the  initial  value  problem  for  differential 
equations.  We  do  not  explicitly  cite  applications  for  the  latter,  but  we  do  illustrate 
computations  on  a  model  problem.  Applications  are  to  be  found  in  circuit  analysis  and 
orbiting  motions,  for  example.  We  demonstrate  three  approaches  to  the  differential 
problem.  The  first,  which  is  most  common,  is  through  singular  perturbation  methods 
and  in  particular,  multi-time  techniques.  The  third  is  a  method  of  averaging  which  is 
independent  of  singular  perturbation  methods.  The  second  method,  the  extrapolation 
method,  falls  in  between. 

References  are  given  to  source  material,  but  ail  of  the  work  reviewed  may  also  be 
found  discussed  in  detail  in  my  monograph  on  stiff  equations  [8], 


2.  Recurrences 


Consider  first  the  model 

xii+1  •  W  +  x0  8iven» 

where  jmR;  and  A  and  B  are  pxp  constant  matrices.  To  illustrate  the  behavior  of  this 
recurrence  it  is  convenient  to  suppose  for  the  time  being  that  A  and  B  commute.  In 
this  case 

x„  -  (A  +  tB)"x0  m  An(I  +  tA~lB)\. 


Then 


xH  m  A"  exp  |/4-lZIenJ*0(l  +  ntO(e)). 


This  demonstrates  the  composition  of  xH  as  it  develops  on  two  scales:  a  rapidly 
developing  part  (viz.  A")  and  a  slowly  developing  part  (viz,  exp  [A~lBen]).  In  many 
cases  the  rapidly  varying  part  is  akin  to  noise  from  which  the  more  meaningful  part  of 
the  solution  needs  to  be  separated.  How  this  separation  may  be  performed  in  more 
general  cases  (i.e.  noncommutative  and  nonlinear  cases)  has  been  demonstrated  in  [6], 
where  a  two-time  formalism  for  recurrences  is  developed. 


We  continue  by  describing  three  applications,  and  we  illustrate  the  separation  of  the 
scales  achieved  by  use  of  a  two-time  technique. 


i)  Training  algorithm 

The  so-called  training  algorithm  (4]  arises  in  pattern  recognition  and  corresponds  to 
the  mathematical  problem  of  determining  a  separating  hyperplane.  Such  a  hyperplane 
is  specified  by  a  vector  w«IR/,+  1  to  which  the  following  recurrence  may  be  made  to 


converge  (in  finitely  many  steps): 


For  fixed  0>O  and  h»q€1R*+1,  define  w,,  *»2.  —  as  follows 


%+t 


+  jr«s(~2r1:jr»)' 


where 


r  1.  »•*<«  ^ 


Vand  xe/4*. 


0,  w*x>0  J 
-l,  wx^-8 


L  0,  wx<-8J 


>and  xtB*. 


Here  /t*  and  B*  are  the  finite  point  sets  in  ft'*1  being  separated.  Setting  wH  ■*  0z(n) 
and  c  m  9~l,  the  recurrence  relation  for  *»_  becomes 


*(n  +  1)  -  z(n)  +  *x  S(r(«)»x  ;  x_) 


while  in  the  definition  of  S,  w  is  changed  to  z  and  8  is  replaced  by  unity. 

The  two-time  formalism  specifies  the  slowly  evolving  aspect  of  the  trajectory  defined 
by  this  recurrence  for  z(n)  as  a  function  z0(j)  where  moreover  z(«)  ■  z0(en)  +  O(e). 

Indeed  z0  is  the  solution  of  the  following  non-stiff  problem: 


I. 


1 


"1 

t 


? 


B 


I 


< 


I 

f 


where  the  average 

_  ,  »-> 

x5(z0)  -  lim  ¥  2  xAS(s0.x„;  x*). 

n~*m 

(In  applications  this  average  is  finitely  computable.)  Computation  of  z0  is  straight 
forward  and  leads  to  a  limiting  vector  which  is  an  appropriate  w  sought  by  the  training 
algorithm. 

ii)  A  population  genetics  model 

In  a  large  population  of  diploid  organisms  having  discrete  generations,  the  genotypes 
determined  by  one  locus  having  two  alleles  A  and  a,  divide  the  population  into  three 
groups  of  types  A  A,  Aa,  and  aa,  respectively.  Suppose  that  the  gene  pool  carried  by 
this  population  is  in  proportion  pn  of  type  A  in  the  nth  generation.  It  follows  [2]  that 

Pn+\  m  Pn  *  - - J . 

Pi,  +  *  -P„)  +  "22< 1  -Pn> 

where  *vu,  wI2  and  w22  are  the  relative  fitnesses  of  the  genotypes  AA,  Aa,  and  aa, 
respectively.  If  the  selective  presses  act  slowly,  i.e.,  if  wu  «  I  +  ta,  w,2  *  1  and 
w22  “!  +  «/*  then 

'*♦'  ‘  '■ + - FTwo - ■ 

The  two  time  formalism  tells  us  that 

p„  -  P(en)  +  0(e), 

-  4  - 


.  J 


where 


Zjj-  -  />(l-/>)[(a-0)/>  +  0]. 

and  this  simple  non-stiff  differential  equation  is  easily  solved  numerically, 
iii)  Regression  analysis 

Let  g(w)  be  a  function  with  a  unique  root  w  and  such  that  ;(w)(w-w)>0,  w#w.  Let 
zk,  k  ■  0,  1, ...  be  a  sequence  of  identically  distributed  random  variables  with  mean 
zero  and  unit  variance.  The  Robbins-Munro  algorithm  for  approximating  w  is  speci¬ 
fied  by  the  following  recurrence: 

w(k  +  1)  -  w(fc)-*«jt[g(w(*))  +  azk\. 

g{w(k))  +  azk  is  a  noisy  measurement  of  g(w(k))  so  that  the  recurrence  specifies  a 
very  chaotic  behavior  for  w(k).  However,  the  two-time  methodology  asserts  that 

w(fc)  -  W0(tk)(\  +  0(e)), 


where 


dW0 

ds 


-«g(W0) 


and 


The  differential  equation  for  WQ  is  simple  to  solve,  and  for  appropriate  g,  its  solutions 
converge  to  the  equilibrium  value  w,  the  root  which  is  sought. 


3.  Two-time  Methods  in  Stiff  Diffsrsntiai  Equations 


The  two-time  method 

The  model  highly  oscillatory  problem  is  taken  to  be 

•  (A  +  eB)m,  u( 0,  71, 


■(0)  -« 


o* 


where  a  is  an  n-vector  and  A  and  B  are  nxn  matrices.  The  solution  is 


KmelU+'BU/']a 


Ar  +  Bt 


where  r  -  t/t.  r  is  called  the  fast  time  and  t  the  slow  time.  If  A  and  B  commute  the 
dependence  of  the  solution  on  these  two  time  scales  separates,  viz, 

-  -  •Ar.Br- 
a  m  e  e  a0, 

and  in  principle,  each  of  the  factors  here  could  be  determined  separately  and  without 
computational  difficulty.  When  A  and  B  do  not  commute  this  separation  is  not  so 
readily  available,  and  moreover,  it  is  not  necessarily  the  case  that  the  development  of 
the  solution  on  the  t-scale  is  even  meaningful  to  approximate  numerically.  To  treat 
this  case  we  employ  the  method  of  two-times.  We  suppose  that  the  initial  condition 
has  the  form 

*(0)  -  2  ®r*r 
rm  0 


and  that  the  solution  of  the  initial  value  problem  has  an  approximation  in  the  form  of 


a  general  two-time  expansion: 


►“1 


a 

i 

w 

Z 


*  *  2  M*-  T)*r- 

rmO 

We  take  the  leading  term  «0(r,r)  of  the  expansion  as  an  approximation  to  the  solution 
of  the  initial  value  problem.  The  method  two-times  ([9])  specifies  m0(l,  r)  as  follows 

u0(t,  T)  * 

where  the  fundamental  matrix  $  (r)  is  given  by 
* 

a)  <frT  m  AQ,  $(0)  «  /. 

Further 

dlt 

b)  ~  -  Bf0,  H0(O)  m  «„, 
where 

c)  B  m  lim  —  f  Q~](o)BQ(o)do. 

r-*-  J0 

(For  the  development  of  this  two-time  methodology  in  a  more  general  non-linear 
setting  see  [5].)  The  specification  of  i i0(t,  r)  leads  to  the  following  numerical  algor¬ 
ithm 

/ 

Algorithm 

i)  Solve  (a)  on  a  mesh  of  increment  k  in  the  r-scale  by  some  self  starting  numerical 

method,  obtaining  the  sequence  j  m  0 . N. 

ii)  Using  the  values  4>0'A)  obtained  in  (i),  approximate  B  by  truncating  the  limit  of  r 
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integration  and  replacing  the  integral  in  (c)  by  a  quadrature  formula,  say 

N 

y  ck*-'uk)*+uu- 
N  % 

The  integer  N  is  determined  by  a  numerical  criterion  which  insures  that  the  elements 
of  the  matrix  ~B  are  calculated  to  within  some  desired  accuracy. 

iii)  With  B  (approximately)  determined  in  (ii),  solve  (b)  for  »0(A)  by  some  self 
starting  numerical  method. 

iv)  Compute  u0(h,  Nk)  <-  <b(Nkji0(h),  and  take  this  as  the  approximation  for  m(h). 

The  approximation  u0(H,  Nk)  produced  by  this  algorithm  is  not  an  approximation  to 
u(h,  Nk)  (i.e.,  is  not  a  pointwise  approximation  in  the  conventional  sense  of  numerical 
analysis).  The  approach  of  this  algorithm  takes  pointwise  approximation  as  ill- 
conditioned  (and  meaningless).  Indeed  approximation  on  the  fast  time  scale  is 
abandoned.  In  fact,  n0(h,  Nk)  is  an  approximation  to  «(r,  Nk)  for  t  near  h  and  not 
necessarily  for  /  «■  h. 

In  the  following  figure  we  schematize  the  computation.  Of  course,  in  practice  e  will 
be  extremely  small  so  that  unlike  the  schematic  an  enormous  number  of  oscillations  of 
♦  will  occur  in  the  t  interval  [0,  h\.  Notice  how  far  the  computed  answer  Q(Nk)r0(h) 
may  be  from  the  customary  approximation  to  the  solution,  «0(A,  h/t). 


The  fundamental  matrix  <t»(r)  is  composed  of  modes  corresponding  to  the  eigenvalues 
of  A.  Since  the  eigenvalues  of  A  lie  in  the  dosed  left  half  plane,  the  profile  for  (a 
component  of)  4  will,  after  some  moderate  number  of  cycles,  settle  down  to  an 

(almost)  periodic  function.  Thus  the  set  of  mesh  points  {jk  \  j  m  0 . N]  may  he 

expected  to  extend  over  just  these  cycles  (approximately). 

4.  The  Extrapolation  Method 

The  exploitation  of  singular  perturbation  theory  for  the  development  of  numerical 
techniques  for  stiff  differential  equations  usually  proceeds  with  the  numerical  determi¬ 
nation  of  values  of  one  or  more  terms  in  the  asymptotic  expansion  supplied  by  that 
theory.  The  extrapolation  method  [7]  which  we  will  now  review  is  a  way  to  break 
through  this  limitation  of  approach. 

Consider  the  following  nonlinear  analogue  of  the  model  problem  which  we  have  been 
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JE 


discussing. 


^  .  /(// e,  x),  x(0)  -  Z. 
dt 

where  x,  /,  {elRn  and  where  /( t,  •)  is  an  almost  periodic  function  of  r.  Multi-time 
perturbation  methods  lead  to  the  approximation 

x(f,  *)  ■  x0(/)  +  *X|(f,  t/ e)  +  0(e2), 
where  x0  is  determined  from  the  initial  value  problem 

-  /(* o>.  *o<°>  -  «• 

/  is  the  average  of  /,  defined  by 

7(x0)-  lim  ~  f  f(r,x0)dr. 

T-~*  r  J0 

The  coefficient  x,  is  determined  from  the  formula 

x,(r,  t/t)  m  x,(r)  +  f  (/(t,  x0)-f(x0)]dr. 

J0 

In  this  formula,  x,  is  determined  at  a  later  step  in  the  perturbation  scheme.  Since  it 
will  not  be  needed  here,  it  is  not  discussed  further.  Thus, 

x(/,*)  a  x0(f)  +  e  jxj(r)  +  J'  [f(r,  x0)-/(x0)]</T|  +  0(t2). 

We  seek  to  determine  certain  larger  values  i  of  e.  The  initial  value  problem  is  solved 
with  these  larger  values  of  e  and  an  appropriate  extrapolation  determines  an  approxi¬ 
mation  to  x(f,  e)  itself. 
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First  the  average  f  must  be  determined.  A  straightforward  numerical  approximation  of 
/  can  be  costly,  but  there  is  the  possibility  of  accelerating  this  computation  by  a 
second  difference  method  which  we  now  describe. 

In  most  applications,  the  integral  of  the  almost  periodic  function  /  has  the  form 

V(T,  x)  -  f(x)T  +  p(T,  x), 

where  p  is  an  almost  periodic  function  of  its  first  argument  and  which  has  mean  zero. 
Thus,  given  a  tolerance  A,  there  is  a  ^-translation  number  3(8,  x)  such  that 

lp(T  +  3(8,x),x)-p(T.x)l  <8 

for  all  T  >  0;  in  particular,  since  p( 0,  x)  ■  0.  then  \p(&(6,  x)  |  <5. 

To  find  candidates  for  3  note  that 

VO. T.  x)-2V(T,  x)  -  pOT,  x)-2p(T,  x). 

In  particular  for  T  »  3(8,  x),  we  have  that 

VO 3,  x)-2V(3,  x)mp03,  x)-p{3,  x)-p{3 ,  x)  +  p(0,  x) 

- 0(8 ). 

Thus,  any  5-translation  number  of  p  makes  this  second  difference  of  order  8.  Unfortu¬ 
nately,  the  converse  does  not  hold;  in  particular,  U  K(27\  x)-2K(7\  x)  ||  may  be  small 
while  ||  p{  T,  x)  II  is  not  small. 

Still,  by  tabulating 

VOT,  x)-2V(T,  x), 
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candidates  for  x )  can  be  found  and  tested  by  comparing  the  values  of  V(T,  x)/T 

for  several  of  them,  since  these  should  all  approximate  fix).  In  practice,  this  method  is 
no  worse  than  the  direct  calculation  of  fix),  and  in  periodic  cases,  it  reliably  gives 
f(x)  after  calculation  over  one  period. 


Thus  we  use 


1 

Pi**) 


L 


fir,  x)dr 


as  an  approximation  to  f. 

The  extrapolation  method  proceeds  by  choosing  an  appropriate  value  T  which  repre¬ 
sents  a  time  at  which  rapid  motions  can  be  ignored.  We  pick  T  to  be  a  4-translation 
number  of  pir,  x).  Then,  in  particular, 

.  1  f*T[fir.  x)-fix)]dr  rn  Oihp), 

for  x  m  £  +  Oih).  The  existence  of  such  a  value  of  T  follows  from  viewing  this 
equation  as  the  statement  that  T  is  an  approximation  to  a  4-translation  number.  Such 
a  T  value  must  be  found,  perhaps  using  the  second  difference  method  just  described  or 
additional  knowledge  about  a  specific  problem  being  studied. 

Once  a  T  value  is  found  we  define 


«'  -  h/T, 

and  then  we  calculate  xih,  if  2)  and  xih ,  t)  from  the  initial  value  problem  by  a 
pth-order  numerical  method.  It  follows  from  the  form  of  the  asymptotic  expansion  for 
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x(r,  *)  above  that 


2x(A,  *72)- 

On  the  other  hand, 
x(h,  t)  « 

1 

since 

Therefore, 

x(h,  «) 


x(A,  *)-x0(A)  +  e'J^  [/(t,  x0(A))— /(x0(A))J<fr  +  0((e,)Z) 
-xo(A)  +  0(A'+‘)  +  O((£)2). 


Xq(A)  +  *x, 


[/(r,  x0(A))-/(x0(A))]*fr  +  0(e2) 


xo(A)  +  0(e), 


rh/ < 

[/(r.  x0(A))-/(x0(A)))dT  -  0(1). 


-  2x(A,  *V2)-x(A,  «')  +  0(e)  +  0(A^+I)  +  0((£)2). 


This  formula  gives  the  extrapolation  method  for  calculating  x(A,  e). 


5.  A  Method  of  Averaging 


We  now  describe  an  example  of  a  numerical  method  which  is  independent  of  singular 
perturbation  methodology  (see  [10]).  For  other  examples  of  methods  which  are 
likewise  independent  see  [1]  and  [2]  the  latter  employing  aliasing. 

Consider  the  following  model  problem 

3r  +  /«( 0.  D. 

When  f(t )  -  X2  sin  t,  this  problem  has  the  following  family  of  solutions 

x(t )  m  a  sin  Xl  +  — sin  . 

1  —  1/A2 

For  X  large,  this  solution  family  consists  of  a  high  frequency  carrier  wave,  a  sin  Xr, 
modulated  by  a  slow  wave,  sin  t/(  1-1/X2).  The  specification  of  the  value  at  a  point 
of  such  a  function  is  all  ill-conditioned  problem. 

The  linear  multistep  class  of  methods  is  highly  desirable  for  numerical  analysis  since 
these  methods  are  easy  to  use  and  easy  to  analyze.  However  these  methods  consist  of 
a  linear  combination  of  unstable  functionals  namely,  solution  values  and  values  of 
solution  derivatives  at  points.  The  method  of  averaging  replaces  these  unstable 
functionals  by  stable  ones,  thereby  producing  a  class  of  linear  multistep  methods 
suitable  for  the  highly  oscillatory  problem.  We  suppose  that  the  stable  functionals 
provide  information  about  the  solution  being  sought,  and  (subject  to  a  process  like 
mesh  refinement)  that  the  stable  functionals  furnish  as  adequate  a  description  of  the 
solution  as  is  needed. 
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Let  r,  s  and  N  be  positive  integers,  let  h  »  T/N  and  let  /,  —  ih,  i  -  0.  ±  1,  ...  be  the 
points  of  a  mesh.  Let  z(f)  be  a  functional  of  x  which  can  be  calculated  at  each  mesh 
point.  Then  we  seek  to  determine  yn  -  >(/„).  in  terms  of  i  »  1,  ....  r  and 
i-O,  1,  ....  s  by  means  of  the  linear  multistep  formula 

2  ai  y*-i  +  2  V— .  -  "  -  °.  1 . N- 

iaO  i—  0 


We  choose  y(i)  to  be 


yU)  -  J*  £(f-j)jr(j)<fc. 


where 


*(z) 


-A  <  z  <  0, 
otherwise. 


Thus  ></)  represents  the  average  of  x(f)  over  the  interval  [f-d,  /]. 

The  functional  z(r)  is  chosen  to  be  [ d^/dt 2  +  \2Jx(f),  i.e.,  /(f),  which  we  suppose  can 
be  stably  calculated  at  each  mesh  point.  ‘Thus  with  a  change  in  normalization,  the 
linear  multistep  formula  may  be  written  as 

yn  -  2  c?n-i  +  *2  2  */«_<• 

i-l  i-O 

Notions  of  local  truncation  error  and  of  order  of  accuracy  of  such  generalized  linear 
multistep  method  (for  functionals)  are  introduced.  They  are  analogous  to  and  generali¬ 
zations  of  the  traditional  ones.  For  example,  let 


Sq  —  1  and  Sj  -  - Cj ,  j  —  1, ....  r. 
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L  -  1/h. 


Then 


m, 


y  jfd - 1 -  y  jf-2  d  fm  o,l, 

f!  jto  J  <'-2)i  fy  ' 


are  so-called  generalized  moments  of  the  method.  The  equations  m(  ■  0,  /  «  0,  1, ... 
are  generalized  moment  conditions. 

View  the  equations  m(  m  0,  /  «  0 . r—  1  as  r  equations  for  the  r  unknowns  Sj, 

j  m  1,  ...,r.  The  /th  row  of  the  resulting  coefficient  matrix  which  has  as  its  jth  term 

u*»i  ,?,<  *  >  1  ' 

is  a  linear  combination  of  the  first  t  rows  of  the  Vandermonde  matrix.  Thus  the 
system  of  r  equations  has  a  solution  in  this  case.  Indeed  by  choosing  the  dj, 

j  m  0 . i  to  be  proportional  to  A~2,  we  obtain  a  solution  for  the  sjt  j  m  1,  ....  r 

which  is  0(1)  +  0(X~2). 

If  the  coefficients  Sj,  j  m  1, ....  r  and  dj,  j  m  0,  ...,j  are  chosen  as  solutions  of  the 
generalized  moment  equations  m,  ■  0,  /  ■  0,  ....  p,  we  may  obtain  an  estimate  of  the 
local  truncation  error  which  is  0(h  ). 

In  addition  to  notions  of  local  accuracy  a  notion  of  stability  for  generalized  linear 
multistep  methods  may  be  introduced.  One  such  condition  is  quite  analogous  to  the 
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classical  one;  namely,  that  the  polynomial 


*<;)«  i*/~' 

>0 


obeys  the  root  condition.  Then  combining  notions  of  local  accuracy  and  of  stability,  a 
global  error  estimate  may  be  obtained. 


Examples 

We  now  consider  some  examples  of  these  methods  in  which  the  coefficients  are 
determined  by  the  generalized  moment  conditions.  In  particular,  we  have  for  /  m  0,  1 
and  2,  respectively: 

0.  m0 

1.  m, 

2.  m2 

Consider  the  following  case  where  the  first  two  generalized  moment  conditions  are 
satisfied. 

A.  m0  m  m,  m  0. 


For  r  m  s  •  1,  we  get 


cl 


,.i  +  2*Vj0. 
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LH 


In  the  special  case  d0  •  0.  this  becomes 


1  .r 


h2\2L 


These  coefficients  (i.e.,  c,)  obey  the  root  condition  if  and  only  if  L  >  1.  In  the 
special  case  d0  m  dx,  we  obtain 


"f1"'  i+i  i 

'do  md\  *  7T7  777 


h2\2  L+' 


Under  the  restriction  L  >  0,  the  root  condition  is  equivalent  to  L  >  0  for  these 
coefficients. 


For  r  m  s  m  2, 


c\mXL~  (1+l)C2+L  x2*2(4,°-rfl)» 


In  the  special  case  d0  ■  0,  c(  >  c2,  dx  »  d2.  this  becomes 


!c  -c 


l\2h2L 


In  this  case, 


\ 


«  ■ 


and  this  polynomial  S(i)  obeys  the  root  condition  for  a  set  of  values  of  L  which 
includes  all  L  >  1. 


In  the  special  case  ct  »  c2,  dx  m  d2  «  0,  c(  and  dx  become 


fl  L 

C*“C2"2  3TT’ 

a  1  3 

0  xV  3  +  L 


*(,)  .  z2_±_£_r_±  -I- 

2  3  +  L  2  3  +  L 


This  polynomi  .1  obeys  the  root  condition  for  a  set  of  values  of  L  which  includes  all 
L  >  0. 


In  the  special  case  c,  -  c2,  d0  -  d,  ■»  d2,  we  obtain 


1  L-l 


1  2  2L+r 

do.J).47-.-k-TLr. 


3  X2A2  *+£ 


In  this  case,  the  root  condition  is  obeyed  .'or  L  >  0. 


Now  we  consider  a  case  corresponding  to  three  generalized  moment  conditions. 


B.  m0  m  m}  m  m2  »  0. 


For  r  m  s  -  1 .  we  get 


‘ 1  +  L + (2i- i2)|  ( fi2  +  ^  7^  )  "  ] 


Notice  that  the  root  condition  is  obeyed  for  L  large  and  positive  but  is  violated  for  h\ 
small  compared  to  L. 


Remark:  In  all  of  these  examples  as  in  the  general  case,  we  see  that  the  coefficients 
obtained  as  solutions  of  the  moment  conditions  depend  on  \  .  At  first  sight  this 
seems  to  be  more  restrictive  than  the  case  of  the  classical  linear  multistep  formulas 
where  the  coefficients  of  the  formula  do  not  depend  on  the  coefficients  of  the  differ¬ 
ential  equation.  In  fact  there  is  no  such  distinction.  In  the  classical  case,  the  coeffi¬ 
cients  of  the  differential  equation  enter  into  the  method  when  it  is  used  to  approximate 
the  differential  equation,  e.g.,  when  yn_(  is  replaced  by  It  is  essential 

after  all  that  the  numerical  method  at  some  point  be  dependent  on  the  equation  to  be 
solved.  In  the  present  development,  this  dependence  occurs  at  the  outset  in  the 
determination  of  coefficients  and  in  the  error  analysis.  In  the  classical  case  it  enters  in 
the  error  analysis  and  in  the  use  of  the  methods. 


Computational  Experiments 


We  now  apply  the  six  sets  of  methods  labeled  I,  II .  VI  above  to  the  model 
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problem: 


x  +  \~x  m  A2  sin  i, 

*(0)-0.  i(0)-4  + - l-T- 

2  1-1/A2 


Computa\ions  are  made  over  the  interval  [0.  7]  ■  [0,  ir].  In  the  following  table  we 
display  ft ^  times  the  /*-norm  of  the  global  error: 

r  f*/*l  -|I/2 


for  a  set  of  various  combinations  of  h  *■  .1,  .01,  A  ■  10,  10*,  10  and  L  *  1,  2,  3  and 
for  each  of  the  six  methods  cited.  Here  [ir/A]  denotes  the  integer  part  of  v/h. 


TABLE 


Method 

A  L 

1 

2 

3 

1 

2 

3 

/ 

1(\ 

.273 

.108 

.112 

.133 

.126 

.126 

10* 

.113 

.00217 

.0611 

.0283 

.00683 

.0083 

103 

.112 

.00209 

.0611 

.0111 

.000106 

.00627 

II 

10 

.122 

.133 

.155 

.126 

.127 

.128 

10* 

.00125 

.0622 

.177 

.0241 

.00926 

.0136 

105 

.00104 

.0621 

.177 

-.000118 

.00627 

.0125 

III 

10 

.242 

.111 

.0872 

.136 

.126 

.126 

10* 

.0032 

.00422 

.00317 

.0294 

.00684 

.00546 

103 

.0034 

.00419 

.00313 

.00023 

.00112 

.89£-6 

IV 

10 

.123 

.111 

.0938 

.126 

.126 

.126 

103 

.00627 

.0144 

.0244 

.0241 

.00684 

.00546 

103 

.00623 

.0144 

.0244 

.000133 

.000179 

.000264 

V 

10 

.144 

.152 

.156 

.127 

.127 

.128 

l°3 

.0657 

.094 

.119 

.0249 

.0116 

.0136 

103 

.0657 

.0939 

.119 

.0063 

.00942 

.0125 

VI 

10 

,758£4 

66£11 

.124 

.  195  £1 

.471£l 

.  1 1  £2 

103 

.0447 

.0639 

.244 

.0246 

.00901 

.0253 

105 

.0447 

.0639 

.244 

.00421 

.00629 

.0251 

1 


A1'2  Hell  ,2 

To  illustrate  both  the  favorable  and  unfavorable  effects,  the  table  contains  cases  for 
which  the  methods  are  designed  to  operate  well  along  with  cases  to  which  correspond 
pooT  or  nonsensical  results. 

For  example  although  the  cases  corresponding  to  X  »  10  give  fair  results,  these  cases 
are  not  stiff,  and  we  should  not  expect  good  results.  When  h  is  decreased,  improve¬ 
ment  should  occur  but  only  for  the  stiff  cases.  The  cases  X  *■  103  and  A  *  .01  are  not 
stiff,  and  improvement  with  decreasing  h  does  not  always  occur  in  these  cases.  Me¬ 
thod  VI  is  used  in  some  unstable  cases.  The  stiff  cases  for  moderate  L  give  extremely 
good  results  as  we  expect. 

In  the  systems  case,  the  model  problem  is  replaced  by  the  second  order  system 

*  +  A2x  -  /(*,  /). 

Here  x  and  /  are  ^-vectors  and  A  is  a  qxq  matrix.  The  coefficients  c]  (and  Sj)  and  dj 
of  the  numerical  method  are  replaced  by  qxq  matrices  (denoted  by  the  same  symbols). 
Many  such  formal  replacements  of  the  scalar  development  follow.  For  example,  the 
first  two  generalized  moments  become 

"o  -(  2  2  dj)sr 

Jm  0  Jm  0 

mi  -(  2  j'j+iz  2  *rA*  2  */,)*«• 

jm  0  *■  jm  0  jmQ 

where  is  the  ^-vector  all  of  whose  components  are  unity. 
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Referring  to  the  remark  above  and  noting  the  dependence  of  the  coefficients  of  the 
numerical  method  on  the  coefficients  of  the  differential  equation,  we  see  from  m0  and 
/it]  here,  the  way  in  which  the  dependence  appears  in  terms  of  the  matrix  A2,  for  the 
coefficients  determined  by  the  generalized  moment  conditions.  It  is  important  to  take 
note  that  the  coefficients  depend  on  the  matrix  A  and  not  explicitly  on  eigenvalues  of 
A“.  Thus,  if  we  know  that  a  system  is  stiff,  with  highly  oscillatory  components,  we 
may  use  the  methods  described  here  without  having  to  calculate  the  eigenvalues  of  A2 
which  cause  this  stiffness. 
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ABSTRACT 

We  consider  the  linear  ODE 

e  gY  =  A1 1  x1  +  A1  lxJ 

<jx  „  A2  ix  i  +  A2  3xj 
at 

For  various  reasons  one  may  be  interested  in  a  "similarly” 
transformed  ODE  that  is  decoupled  such  that  one  has  a  pos¬ 
sibility  to  compute  the  fast  and  slow  modes  and  (or  the 
decreasing  and  increasing  modes)  separately.  We  propose 
a  technique  the  employs  a  Riccati  transformation  for 
decoupling  the  two  time  scales  and  a  Liapunov  type 
of  transformation  to  decouple  increasing  and  decreasing 


1 


2. 


fast  modes.  The  last  technique  is  numerically  implemented 
as  a  special  predictor-corrector  technique,  which  employs 
a  QU-decompo;ition  each  corrector  step. 

1.-  PROBLEMSETTING 
Consider  the  linear  ODE 

(1.1)  dx2 

^  3  fi2  l  X1  +  A2  2  x2  +  fa  t  >  0 

where  A11,  A11,  A11  and  A* 2  are  matrix  functions  of  t  and 
r1  ,  r2  are  vector  functions  of  t.  We  assume  that  A22  is 
nonsingular  for  all  t.  In  fact  for  our  discussion  only 
the  homogeneous  part  of  (1.1)  is  of  importance,  as  will 
turn  out  later.  Problems  with  slow  and  fast  time  scales 
(as  expressed  by  the  '’small"  parameter  e)  arise  both  in  IVP 
and  BVP.  We  restrict  ourselves  to  the  latter  class  of 
problems.  They  differ  from  IVP  in  that  they  usually  deal 
with  ODE  that  have  increasing  and  decreasing  modes.  Due 
to  the  instability  with  respect  to  initial  values  of  the 
former,  serious  numerical  difficulties  may  arise  if  one 
tries  to  compute  them  (as  may  be  necessary  to  obtain  a 
fundamental  solution  in  solving  the  BVP).  However,  for 
the  same  reason  as  the  increasing  modes  make  forward 


« 
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integration  an  unstable  affair,  the  decreasing  modes 
render  backward  integration  unstable.  Therefore  we  look 
for  methods  that  decouple  the  differential  equation  into 
slow  and  fast  modes  on  the  one  hand  (in  order  to  local¬ 
ize  the  stiffness)  and  in  increasing  and  decreasing  modes 
on  the  other  hand  (in  order  to  circumvent  the  above  men¬ 
tioned  instability).  We  shall  do  this  by  transforming 
the  homogeneous  part  of  (1.1)  onto  (block)  uppertriangular 
form,  using  linear  transformations  T(t),  i.e.  we  determine 
U* 1 ,  U2 1  and  U2 2 ,  such  that  by  setting 

we  have 

a) e^l  .  U1 1  y1  +  U1 2 y2  ♦  (T^r)1 

(1.3) 

b)  =»  U2 2 y2  +  (T-‘Ol 

The  ODE  (1.3)  (b)  has  smooth  solutions.  Hence  one  may 
e.g.  apply  a  multiple  shooting  technique  for  determining 
a  fundamental  solution  and  a  particular  solution  of  it. 
Once  the  component  y2  of  a  solution  has  been  determined 
we  are  left  with  an  (inhomogeneous)  stiff  ODE  for  y1  . 

The  U‘ 1  now  has  an  upper  triangular  form, 


4. 


(1.4) 


U1  » 


B  of  order  m  say. 


such  that  B  belongs  to  a  system  describing  the  increasing 
modes  and  E  similarly  the  decreasing  mod-js.  If  we  parti¬ 
tion  the  vector  y1  correspondingly  as  t*ien  z*  sh°uld 

be  computed  in  forward  direction,  for  which  we  may  use  a 
stiff  integrator,  and  similarly  z1  in  backward  direction 
afterwards.  In  Section  2  we  first  describe  the  decoupling 
of  slow*  and  fast  time  scales.  In  Section  3  we  then  show 
how  the  fast  system  may  be  decoupled  further.  The  latter 
decoupling  is  done  by  a  predictor-corrector  method,  the 
convergence  of  which  is  shown  in  Section  4  and  its  stabH 
ity  in  Section  5. 


2.-  DECOUPLING  OF  SLOW  AND  FAST'  MODES 

For  the  matrix  T  we  choose  the  (generalized)  Riccati 
transformation 

(2.1)  T(t)  - 


we  obtain  then 


M(t)  0\ 

)  ,  M(t)  nonsingular. 
P  (t)M(t)  1/ 


5. 


(U‘ 1  U12\  /m_,[  (A1 ‘+  A1 2P)-  e  Ml  M~‘  A1  2  \ 

<t>  U22J  y  0  -PA*2  +  A2,J 

provided  P  satisfies  the  Riccati  equation 


(2.3)  e  P  =  PA11  +  PA1 2  P-eA2  2  P-eA2  1 

It  is  of  importance  now  to  realize  that  we  are  free  to 
choose  the  initial  value  P(0)  of  (2.3).  In  particular  we 
may  try  to  choose  P(0)  such  that  P  is  smooth.  From  power 
series  expansious  arguments  (see  e.g.  Mattheij  ,  O'Malley, 
this  proceedings)  we  may  therefore  expect  P(0)*0  to  be  a 
good  choice.  Rather  than  computing  P  by  some  stiff  inte¬ 
grator,  we  suggest  to  compute  a  few  terms  of  its  power 
expansion  in  e.  Let 

(2.4)  P(t)  -  2  ejP. (t) 

j  >0  J 

then  we  have  e.g. 

(2.5)  0  *  - A2  2  P  -A21  , 

0 

whence 


(2.6)  P  *  -{  A2  2 ] " 1  A2 1 

0 

And  also  for  the  first  order  term 

(2.7)  P«PAn  +  P  A‘2P  -  A2  2  P 

0  0  0  0  1 


1 
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Since  P  can  be  found  analytically,  i.e. 
o 

(2.8)  p  =  [  A2  2 1  “ 1  (A22[  A’M-'A** -A21  }  , 

0 

P  follows  from  (2.7)  and  (2.8)  etc. 

The  attractive  feature  of  this  approach  is  that  it  can 
be  carried  out  without  introducing  discretization  errors 
and  therefore  is  very  suited  to  be  combined  with  a  numer 
ical  method  that  requires  certain  stepsizes  in  order  to 
compute  e.g.  solutions  of  (1.3)  (a). 

3.-  FURTHER  REDUCTION  OF  THE  FAST  SYSTEM 

Thus  far  we  didn't  specify  the  matrix  M.  We  now  require 
U1 1  to  have  an  upper  triangular  form  and  therefore  we 
have  to  determine  M  such  that 
(3.1)  eM-FM-MU,  where  F*A‘ 1 -A1 2  P,  U»U*  1 

If  we  assume  that  the  directions  of  the  solutions  of  the 
homogeneous  part  of  (1.1)  are  only  slowly  varying,  we  may 
expect  that  (3.1)  has  a  smooth  solution  M,  such  that  M(t) 
is  orthogonal  for  all  t.  To  understand  this  one  should 
realize  that  e.g.  the  first  column  of  M  represents  the 
"direction"  of  some  solution  of  the  ODE  y‘ *Fy'  ,  and 
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the  first  two  columns  "span"  a  two  d'mensional  solution 
subspace  etc.  In  order  to  find  such  M  and  U  we  propose 
a  predictor-corrector  technique,  where  the  corrector 
utilizes  a  kind  of  QR  algorithm  that  ultimately  gives  the 
orthogonal  matrix  M  and  the  upper  triangular  matrix  U. 

We  shall  only  sketch  the  method.  Suppose  we  have  a  cor¬ 


rector 

n  .  n  . 

(3.2)  2  a  zJ  ;  2  fi.z\  a  «1  ,  0  *0  , 

j  =  0  J  j«0  J  oo 

then  a  typical  corrector  step  has  the  form 


(3.3)  M{u{  .'FjMi-1-  uf  Mj-'.Cj., 


In  (3.3)  we  have  set  Fi*F(ti),  M?-  the  jth  correction 
step  for  M(t^)  and  similarly  ;  finally  G.^  ^  contains 


the  rest  of  the  terms,  only  depending  on  previous  time 


steps.  In  the  next  section  we  deal  with  the  convergence 
of  the  iteration  (3.3)  and  in  Section  5  with  the  accuracy 

OO 

of  the  approximation 


4.-  CONVERGENCE  OF  THE  CORRECTOR  METHOD 


We  write  more  conveniently  the  iteration  (3.3)  as 
(4.1)  nW  *  HM^+G  , 


i.e.,  we  omit  the  indices  and  write  for  short 
C4.2)  H  -  (F  -  hV) 
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[Tj 


We  shall  restrict  ourselves  to  matrices  F  having  a  complete 

system  of  eigenvectors  e,  *****en>  corresponding  to  the 

(ordered)  eigenvalues  *  , . . .  (X  >\  >  . .  .>  X  ). 

i  n  i  j  n 

Moreover  we  shall  only  investigate  the  convergence  of 

the  first  column  of  M-* ,  m^  say.  Let  G(1)  denote  the 

first  column  of  G,  then  there  exist  scalars  y  ,...,7 

1 

such  that 


n 


(4.3) 


G(1) 


n 

2  7iei 
j«1  3  3 


It  is  not  restrictive  to  assume  that  all  7^<0.  We  now 
first  investigate  the  fixed  points  (if  any)  of  the  itera¬ 
tion  (:f (4. 1)) 

(4.4)  m^v^  *  H  m^-1+G(1),  ||  m^||  *||m^||  «1 

2  2 

Hence  suppose  for  some  vector  m  with  ||  m||  *1  and  some 

2 

scalar  v  there  holds 

(4.5)  m  v  *  H  m  ♦  G( 1 ) 

Note  that  (4.5)  might  be  regarded  as  an  "inhomogeneous 
eigenvalue  problem". 


Now  write 

(4.6)  m 


n 


2 


f  1 


n 


then  we  obviously  have 

(4.7)  (v-X£),i£  =  7 


r 


£*1  ,  • • . ,n 


t 


9. 


0 


■ 

2 


Hence 

Property  4.8  If  7^  ^  0  for  any  i,  then  M^^O. 

Now  let  k  be  such  that  7k^0,  then  we  obtain  from  (4.7) 


7 


(4.9) 


v(Vxi 


)*, 


The  actual  values  for  #*k  (and  hence  for  the  other  m^) 
follow  from  the  requirement  if  we  write  for 

short 

(4.10)  e^  »  (e^  ,e j ) 

(the  natural  inner  product),  then  we  must  require  that 
(4. H)  fk(Mk)  »  1, 
where 

n  e..y.y. 

(4.12)  f.  (x)  =  x2  2  - U-L-l - 

ij*1  (7k+(xk’Xj)x)  (7k+(Xic’Xi)x) 

It  is  not  restrictive  to  take  k  minimal.  Since  by 
definition  f  is  positive  definite  (x^O)  we  have  a  graph 
like  in  fig  4 .  1 


i 

! 


Hence  there  are  at  least  two  values  of  x  such  that 
Denote  the  negative  root  of  f^(x)=1  by 
We  have  then 

Theorem  4 . 1  The  choice ksak  (<  0)  is  the  only  stable 

one  and  gives  a  fixed  point  m  of  (4.5)  with  the  largest 
7  k 

possible  v=x  .♦  — 
k  Mk 

That  we  should  choose  for  obtaining  the  largest 

possible  v  is  trivial  (n.b.  T^O!).  The  stability 
follows  from  a  perturbation  argument. 


CONCLUSION 

The  sequence  (mJ)  converges  to  a  unique  vector  m  and  the 
sequence  (v^)  converges  at  the  same  time  to  a  scalar  v, 
and  they  moreover  form  the  largest  possible  pair  (m,v). 

Now  if  m(t^  j)  was  the  approximate  direction  of  the  most 
increasing  solution  at  time  t*t^  then  it  can  be  expect 
ed  that  m(t^)  computed  this  way,  will  approximately  have 
the  direction  of  this  solution  at  t  =  t^.  Indeed,  to  see 
this,  let  for  simplicity  F  be  a  constant  matrix,  and 
m  ( t  i )  *e^  /(le,  II  .  Then  apparently  ^(1)  has  the  direction 


1 1 . 


of  e  ,  whereas  y  z/hP  and  y  ,...,y  are  small. 

1  1  o  2  n 

From  (4.11),  with  k*1,  we  thus  see 
(4.14)  1  *  li1  , 

i 

whence  v  *  y  * 

1  o 

Since  X  is  the  largest  eigenvalue  of  H(=F-  j^r-  I) 
we  therefore  see  that  v  is  approximately  the  largest 
eigenvalue  of  F! 

By  similar  arguments  as  are  used  to  show  convergence  of 
the  QR  algorithm  one  can  expect  that  the  general  process 
(4.1)  will  converge  in  a  stable  way  to  some  M  and  U. 

In  order  to  find  initial  values  for  M  and  U,  one  may 
use  an  appropriately  ordered  Schur  normal  form  of  F(0). 


5.-  ACCURACY  OF  THE  DECOUPLED  DIFFERENCE  EQUATION 

Since  the  above  described  method  necessarily  introduces 
discretization  errors,  the  actually  found  upper  triangular 
matrices  U^^  will,  in  general,  not  correspond  to  an  exactly 
transformed  ODE.  The  following  qualitative  discussion  is 
concerned  with  this  problem. 


12. 


Let  M(t)  be  a  piecewise  polynomial  that  is  sufficiently 
differentiable  (at  least  as  many  times  as  the  order  of 
the  corrector)  and  moreover  such  that 

(5.1)  M(t.):«  M. 

For  this  M,  which  is  a  certain  transformation  function 

A 

now,  define  a  matrix  function  U(t)  by 

(5.2)  U  *  M'1 (AM-eM) 

If  we  (theoretically)  discretize  (5.2)  we  make  a  discreti 
zation  error  hA^  say.  Apparently,  using  the  notation 

/V  A 

Ui:=U(ti),  we  must  then  have 

n 

(5.3)  0  =  h  2  0  .M. (U. -U. ) +  hA. 

j-0  3  1  1  1  1 

(for  simplicity  we  assume  constant  step  sizes).  Let 
n  i 

the  polynomial  2  0  zJ  have  stable  roots  only,  then  it 
j *0  J 

follows  from  a  standard  error  analysis  that 

(5.4)  IIU.  -U.ll  *0(2  (||A  ||/h)J  , 

1  1  U-1  / 

i.e.  of  the  order  (h^*1)  for  a  pth  order  method.  (Note 
that  is  orthogonal). 

Whether  or  not  these  errors  in  are  clearly 

depends  on  the  values  of  the  magnitudes  of  the  elements 
of  U^,  which  carr  be  monitored.  Moreover,  we  can  monitor 
the  local  errors  quite  conveniently  by  taking  (p+l)th 
divided  differences  of  the  matrices  M^. 
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1. 


Introduction 


We  wish  to  consider  linear  two-point  boundary  value  problems 
of  the  form 

(D  ||  =  a (t)  x+f  ( t) ,  0  <  t  S.  1 
(2)  MqX(O)  +  MjXd)  =  b 

where  the  homogeneous  system  involves  coupled  slow  and  fast  dynamics. 
This  contrasts  sharply  with  most  mathematical  discussions  of  singu¬ 
larly  perturbed  systems  where  a  small  parameter  multiplies  some  of 
the  derivaties  and  slow  and  (potentially)  fast  components  of  the 
solution  vector  are  immediately  recognized.  Special  numerical 
methods  are  available  for  stiff  initial  value  problems  with  slow 
and  fast  components  identified  (cf.  Soderlind  (1981))  and  Riccati- 
like  transformations  are  available  to  decouple  such  problems 
analytically  and/or  numerically  (cf.,  e.g.,  O'Malley  (1969), 

Mattheij  (1979),  and  O'Malley  and  Anderson  (1982)).  In  this  paper, 
we  propose  a  different  type  of  transformation  which  will  be  useful 
in  more  general  situations.  We  expect  to  numerically  implement 
our  algorithm  and  to  pursue  important  generalizations  in  several 
directions.  Relation  to  ongoing  work  of  past  and  present  colleagues 
and  friends  will  be  obvious  to  those  familiar  with  earlier  work 
(cf . ,  especially,  Ferguson  (1975),  Flaherty  and  O'Malley  (1980), 
Mattheij  and  Staarink  (1980),  and  Chow  et  al.  (1981)).  They  are 
all  thanked  for  their  stimulation  and  encouragement. 

Our  basic  assumption  is  that  the  homogeneous  system  has  both 
smooth  (or  "slow”)  and  rapidly-varying  (or  "fast")  solution  modes. 
This  requires  the  matrix  a.(t)  to  have  large  entries,  so  to  make 


2. 


our  hypotheses  more  explicit,  we  introduce  a  small  positive 

scaling  parameter  e  and  write 

00 

(3)  a  (t)  -  iA(t,e)  *  jr  ^  A^(t)ej 

j^O 

He  do  not  actually  intend  to  use  a  full  power  series  expansion 
here  (or  below) ,  but  would  in  practice  use  a  truncated  expansion 
(approximation)  involving  only  a  few  terms.  Thus,  our  n-vector 
system  takes  the  form 

(4)  *  A(t, e) x  +  ef(t) 

where  the  presence  of  slow  modes  implies  that  A(t,0)  *  Afl( t)  is 
a  singular  matrix.  Since  the  nonhomogeneity  can  be  dealt  with 
by  variation  of  parameters,  most  of  our  attention  will  be  re¬ 
stricted  to  the  homogeneous  problem. 

He  shall  seek  a  change  of  variables 

(5)  x  »  T (t,e)y 

where  T  and  T-1  are  both  smooth  (slowly- varying)  throughout  the 
interval  0  *  t  S  1.  (Appropriate  assumptions  will  be  introduced 
as  our  discussion  proceeds.)  The  transformed  problem  will  take 
the  form 

(6>  Eat  ■  u(t'e)y  +  eT_lf 

where 

U  ■  T-1 (AT  -  e|£) 


(7) 


3. 


We  shall  determine  T  and  U  simultaneously  so  that  (J  has  the 
block  triangular  form 
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where  the  eigenvalues  of  U  and  -U  all  have  strictly  positive 
real  parts  (at  least  for  e  small) .  Thus,  the  rapidly-varying 
solution  modes  of  the  transformed  homogeneous  problem  will  be 
either  fast-growing  or  fast-decaying,  but  not  (indefinitely) 
rapidly  oscillatory.  We  shall  assume  that  the  partitioning  holds 
throughout  the  interval  0  £  t  -  1,  thereby  implicitly  eliminating 
possible  "turning  points”  within  the  interval  (cf.  Wasow  (1965)). 
The  matrix  T,  then,  corresponds  to  a  decoupling  transformation 
which  separates  rapidly  growing,  rapidly  decaying,  and  slow  modes. 
The  time  scales  for  the  rapid  modes  will  be  roughly  0(l/e)  times 
those  for  the  slow  inodes.  The  reason  we  don't  allow  purely 
imaginary  eigenvalues  of  U(t,0)  is  that  we  wish  to  base  our 
analysis  on  boundary  layer  methods  (cf.  O’Malley  (1974)).  We 
shall  further  presume  that  we  can  obtain  smooth  dependence  of 
the  Uij  s  on  e,  although  dependence  on  some  root  e*^r,  for  some 
integer  r  >  1,  would  be  necessary  in  some  degenerate  situations 
involving  defective  eigenvalues.  These  neglected  possibilities 
should  be  considered  in  later  work. 

In  order  to  proceed,  let  us  fix  the  dimensions  of  and 

22 

U  to  be  k  x  k  and  Z  x  Z,  respectively,  and  write  T  as 
T ( t, e )  =  T  ( t ,  0)  [In  +  eG(t,e)  ] 


(9) 


4. 


where  G  will  ultimately  have  the  special,  compatibly  partitioned 
form 


00 

*  2  (G,a6(t))ej  . 

j*0  3 


At  several  stages,  we  make  somewhat  arbitrary  choices  for  the 
form  of  our  transformations.  Though  these  cause  us  no  complica¬ 
tions,  others  might  find  different  choices  more  appropriate.  Our 
decoupling  will  be  done  in  two  steps.  First,  we  shall  separate 
fast  and  slow  time  scales.  Then,  we  split  fast-growing  and 
fast-decaying  modes  to  higher  orders  in  e.  We  shall  let  m  =  n-k-i 
designate  the  number  of  slow  modes  with  bounded  derivatives  as 
e  -*■  0. 


2 .  Time- scale  Decoupling 

At  our  first  decoupling  stage,  it  is  convenient  to  tempor¬ 
arily  combine  notation  somewhat.  Splitting  T  after  its  first 
k  +  l  columns,  we  set 


(11)  T(t,e)  = 
Introducing 

(12)  B ( t,e )  - 


(R(t,c)  Z(t,e) )  . 


and 


5. 


(13)  C(t,e)  = 

the  equation  (7)  defining  U  implies  that  the  fast  decoupling 
transformation  R(t,e)  must  satisfy  the  linear  matrix  (Liapunov) 
equation 

(14)  eR  =  AR  -  RB  . 


Since  A  and  B  have  power  series  expansions  in  e,  it  is  natural 
to  seek  a  smooth  matrix  solution  R  in  the  form 

CO 

(15)  R( t, e)  ^  2  R.  (t)ej  . 

3=0  3 

We  shall,  indeed,  simultaneously  determine  a  formal  series  solution 
for  this  differential  equation  and  for  the  block-triangular  system 
matrix  B(t,e)  for  the  transformed  fast  subsystem.  Specifically, 
by  equating  coefficients  we  obtain 


(16) 


A0R0  ”  **oB0  **  B 


and,  for  each  j  -  1, 


(17) 


A0Rj  "  RjB0  *  R0Bj  +  aj-l 


where  the  are  known  in  terms  of  preceding  coefficients. 

To  solve  our  problem,  we  introduce  the  Schur  canonical  form 


(18) 


A0  =  Wo 


for  the  principal  part  AQ ( t)  of  our  system  matrix  ea(t) .  Here, 
Qg(t)  is  orthogonal  and  V^(t)  is  upper  triangular,  so 


(19) 


6. 


We  observe  that  these  matrices  are  convenient  to  obtain  numerically 
through  the  QR  algorithm  (cf.  Golub  and  Wilkinson  (1976)).  This 
provides  a  full  triangularization  for  AQ,  though  a  block-triangular- 
ization  would  suffice  for  much  of  our  paper.  We  shall  set 


and,  without  loss  of  generality,  we  suppose  that  the  first  k  (and 
remaining  l)  eigenvalues  of  the  (k  +  1)  x  (k  +  l)  matrix  BQ  will 
have  strictly  positive  (negative)  real  parts  throughout  the 
interval  0  5  t  -  1.  This  clearly,  but  definitely,  restricts  the 
matrices  A^(t)  under  consideration.  The  matrices  BQ(t)  and  Cq  (t) 
so  specified  determine  our  limiting  transformed  system  matrix  U(t,0). 
Moreover,  with  such  an  ordering  of  the  eigenvalues  of  BQ,  we  separate 
the  fast  growing  (first  k)  and  fast  decaying  (next  l)  modes  at  this 
first  (and  critical)  order  (with  respect  to  e) .  If  we  further  let 
Rq  coincide  with  the  first  k  +  l  columns  of  Qq,  we  satisfy  the 
desired  linear  system  AqRq  -  RqBq  *  0  and  specify  the  fast  part 
Rg(t)  of  our  limiting  transformation  matrix  T(t,0).  Its  rank, 
k  +  l,  coincides  with  that  of  Ag(t). 


3 .  Higher-order  Terms 


Since  QqRq 


Ci 


through  by  Qq  and  setting 


multiplying  the  linear  system  (17) 


7. 


implies  the  pair  of  equations 


B0kj  +  co*j  -  *jB0  -  Bj  +  “j-1 


^2  2 
'RjB0  *  aj-l 


where  the  Oj_1*s  are  known  successively. 

Since  the  triangular  matrix  Bq  is  simply-inverted  by  back  sub- 
a>2 

stitution,  Rj  is  uniquely  determined  and  a  linear  system 
(24)  Bqr1  -  R^B0  -  Bj  + 


1  'X'2  'VI 

with  6j_1  *  aj_i  +  coRj  reBiains*  We  now  seek  to  specify  Rj  so 

that  the  resulting  fast-growing  and  -decaying  modes  are  separated 
(to  the  appropriate  order)  by  making  Bj  upper  triangular.  Sub¬ 
stituting  for  Bq  and  Bj ,  we  seek  a  solution  of  the  form 


'M 

Rj(t) 


This  provides  the  four  linear  matrix  equations 

/  of  of  -  of  uf  -  ,« 


22  21  _  21  11  _  21 
U0  Gj  Gj  U0  8j-l 


12  21  _  11  flll 

U0  Gj  ”  Ui  +  Bi-] 


21  12  _  22  22 
-Gj  UQ  -  Uj  +  Bj.j, 


presuming  we  can  take  Uj  =0  for  j  >  0.  The  first  two  systems 


8. 


are  uniquely  solvable  for  Gj2  and  G2^,  respectively,  since 
22 

and  Uq  have  no  eigenvalues  in  common.  Indeed,  the  triangular 
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form  of  UQ  and  Uq  allows  a  simple  solution  for  these  nonzero 
'''l 

blocks  of  Rj  by  forward  and  backward  substitution.  Then,  the 
last  two  equations  directly  specify  the  block-diagonal  matrix 
B .  The  procedure  can  be  continued  to  any  desired  order. 

To  determine  the  full  transformation  T(t,e) ,  we  must  select 
a  matrix  Z(t,e)  whose  span  is  complementary  to  that  of  R(t,e). 


It  is  natural  to  attempt  to  take  T(t,0)  =  Q-(t).  Then 


*\>1 

R  (t,e)  * 


nd  R2 ( t , e )  =  (G31  G32) . 


The  T  matrix  so  obtained  is  readily  inverted  since 


T  -  Q, 


%1 

Xk+1  +  eR 


implies  that 


^1 

(Ik+£  +  eR  > 


-eR 


ii,-i 


(Ik+t  ♦  eR‘> 


H  -eg12\  /(Ve2G12G21»  _1 


-eG21  xt 


(Il*c  °21G12j 


at  least  for  e  sufficiently  small. 


9. 


and  Uj (t) . 


10. 


We  should  verify  that  the  truncated  series  actually  provides 
decoupling  to  a  corresponding  order  and  that  analytic  transforma¬ 
tions  exist  with  asymptotic  expansions  coinciding  with  the  formal 
series  generated.  It  should,  however,  be  realized  that  our  approach 
is  not  necessarily  limited  to  asymptotic  validity  as  e  ♦  0,  but 
that  the  decoupling  achieved  should  be  numerically  valid  for  any 
realistic  small  e  for  which  our  algorithm  is  defined. 


4.  Boundary  Value  Problems 

The  principal  value  to  our  approach  is  the  simplicity  it 
provides  for  solving  two-point  boundary  value  problems.  In 
y-coordinates ,  our  problem  (1)  -  (2)  becomes 

(35)  =  U(t,e)y  +  eT-1 (t, e) f (t) 


(36)  MQT(0,e)y(0)  +  M^d.eJyd)  *  b  . 


If  we  first  find  a  particular  bounded  solution  of  (35) ,  using 
boundary  conditions  appropriate  to  the  conditional  stability  of 
our  fast  subsystem,  we  need  after  only  consider  the  homogeneous 
system. 

All  solutions  of  the  homogeneous  system  have  the  form 


0 


0 
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subject  to  special  boundary  conditions  at  the  endpoints  t  =  0  and 

ct  6 

t  *  1  which  will  assure  us  boundedness  of  the  Q  's.  Specifically, 
we'll  define  Q  on  0  i  t  <  1  by  asking  that 


-  U33n33  . 


.  o22!)22 


fi33(0)  =  I 


22 

(0)  =  i, 


dn11 

eST 


u22n23  +  u23n33  ,  a23(0) 


u11^11  ,  n11(i)  ■  i. 


unn12  +  u12n22  ,  n12 (i) 


e^_  *  unn13  +  u12n23  +  u13n33  ,  n13(i)  *  o 


As  £  -►  0,  we  note  that  u  decays  rapidly  to  zero  for  t  >  0  (i.e., 
away  from  an  initial  boundary  layer) ,  while  ft11  rapidly  decays  to 
zero  away  from  a  terminal  boundary  layer  near  t  =  1.  Away  from 
t  =  0,  n23  tends  to  an  outer  limit  (U22)  ^U23^33  as  e  -*•  0. 

and  involve  boundary  layer  behavior  at  t  =  1.  Such 

asymptotic  results  readily  follow  from  singular  perturbations 
theory  (cf.  O'Malley  (1974)). 

Since  any  solution  of  our  homogeneous  problem  (1)  -  (2) 
has  the  form  (37) ,  we  obtain  a  unique  solution  if  and  only  if  the 
matrix 


D  =  MqT ( 0 , e ) ft (0 , e )  +  M1T(lfe)fl(l,e) 


is  nonsingular.  Moreover,  the  special  structure  of  T(t,e)  and  of 
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ft(0,e)  and  fl(l,e)  can  be  utilized  to  simplify  the  checking  of 
this  invertibility  condition.  If  D  =  O(e^)  as  e  +  0,  we  can 
anticipate  having  solutions  which  become  algebraically  unbounded 
like  e”*3.  We  can  even  identify  the  limiting  behavior  as  e  -*■  0 
within  (0,1)  with  the  solution  of  a  reduced  boundary  value  problem 
of  order  m  (cf.  O'Malley  (1969)  and  Harris  (1973)).  Special 
numerical  interest,  however,  concerns  problems  where  c  is  small, 
but  nonvanishing. 
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subject  to  special  boundary  conditions  at  the  endpoints  t  =  0  and 

Cl  3 

t  -  1  which  will  assure  us  boundedness  of  the  ft  's.  Specifically, 
we'll  define  ft  on  0  £  t  <  1  by  asking  that 


-  u33n33  , 


.  023232 

at 


ft33  (0)  =  I 


22 

ft (0)  =  I, 


U22ft23  +  U23ft33  ,  ft23(0) 


U11^11  ,  fti;L(l)  ■  I. 


Unft12  +  U12ft22  ,  ft12(l) 


e^5t“  *  uxln13  +  u12ft23  +  u13ft33  ,  ft13(i)  =  o  . 


As  e  +  0,  we  note  that  ft  decays  rapidly  to  zero  for  t  >  0  (i.e., 
away  from  an  initial  boundary  layer) ,  while  ft11  rapidly  decays  to 
zero  away  from  a  terminal  boundary  layer  near  t  =  1.  Away  from 
t  =  o,  ft23  tends  to  an  outer  limit  (U2 2 )  ^U23^)33  as  e  +  0. 
ft12  and  ft13  involve  boundary  layer  behavior  at  t  =  1.  Such 
asymptotic  results  readily  follow  from  singular  perturbations 
theory  (cf.  O'Malley  (1974)). 

Since  any  solution  of  our  homogeneous  problem  (1)  -  (2) 
has  the  form  (37) ,  we  obtain  a  unique  solution  if  and  only  if  the 
matrix 


(40)  D  =  MgT ( 0 , e ) ft ( 0 , e )  +  MjT ( 1 , e ) ft (1 , e ) 

is  nonsingular.  Moreover,  the  special  structure  of  T  ( t , ■  in. 
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ft(0,e)  and  ft(l,e)  can  be  utilized  to  simplify  the  checking  of 
this  invertibility  condition.  If  D  «  0(ep)  as  e  +  0,  we  can 
anticipate  having  solutions  which  become  algebraically  unbounded 
like  e”p.  We  can  even  identify  the  limiting  behavior  as  c  ♦  0 
within  (0,1)  with  the  solution  of  a  reduced  boundary  value  problem 
of  order  m  (cf.  O'Malley  (1969)  and  Harris  (1973)).  Special 
numerical  interest,  however,  concerns  problems  where  e  is  small, 
but  nonvanishing. 
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INTRODUCTION 


Consider  Chs  autonomous  retarded  differential-difference  equation 

f(t)  -  fCy(t),y(t-r.) . y(t-T  )]  (la) 

with  the  initial  function 

*(t)  “  $(t)  Ct  e  C-t.OJ),  (lb) 

where  t  ■  max^  ^  ^  ^  m}^Tl^*  Suppose  the  function  f  is  sufficiently 

differentiable;  then  we  have  at  (0,0, ... ,0)  —  chosen  for  notational  con¬ 
venience-— 

t  0 

{ ^?0*-l*  *  *  **^a^  "  J^9*9*****9^  ^  ^i»o  -^^i  8^o*-l*  *  *  (2) 

where 

(0,0,... ,0)  (3) 

*i  ' 

and 

“V  n,  . fcJllAiolhill  '  <4> 

Assume  that  there  exists  an  a  such  that 

f  (9.9 . 9)  +  •  9  <5> 


Nov,  set  j(t)  ■  x(t)  +  a;* then  (1)  with  (2)  end  (5)  yields  the  autonomous 
retarded  differential-difference  equation 

*(t)  -  F°x(t)  +  lJ.1Fix(t-T1) 


+  gCx(t)4o,  x(t-T1)4n,...,x(t-TB)+o] 


(6a) 


2 


with  the  Initial  function 

x(t)  ■  $(t)  -  a  (t  <  C-t,03)  ^  (6b) 

It  Is  out  of  consldsrstion  of  (6s)  that  va  vara  lad  to  consider 

u(t)  -  P°u(t)  +  iJ.jlV*-**)  (7a) 

with  the  Initial  function 

u(t)  ■  *(t)  (t  t  C-r,03)  (7b) 

as  an  arch* type  aquation  against  which  to  assess  the  stability  properties  of 
numerical  methods  for  the  solution  of  (1).  In  [13  we  defined  F-stability 
and  F[a, gj-stability  with  respect  to  (7)  for  a  multistep-method/Lagrange- 
method  pair  and  displayed  pairs  exhibiting  such  stability  types. 

In  this  paper  we  turn  to  a  special  case,  that  when  (7)  Is  a  scalar 
equation  with  just  one  delay.  For  this  distinctive  ease  we  replace  (7)  by 

fl(t)  -  pu(t)  +•  qu(t-t)  (8a) 


with 

u(t)  -  *(t)  (t  *  [-t,03).  (8b) 

In  [23,Barwell,  extending  results  reported  by  Cryer  in  [33,  proposed  this  as 
an  archtype  equation.  He  there  Introduced  the  P-at ability  and  GP-stability 

types.  These  types  differed  only  In  a  restriction  on  t  In  the  former  type. 

•  • 

Since  we  will  not  distinguish  two  typed  by  such  a  restriction,  we  will  need 
only  one  type  designator.  For  simplicity,  ve  shall  adopt  the  former  desig¬ 
nator  (P-stability) ,  but  with  a  definition  to  suit  our  exposition. 
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BACKGROUND 

We  shall  say  that  the  arehatype  equation  (8a)  is  p-dominant  if 
Re(p)<-|q|. 

The  asymptotic  behavior  of  the  solution  of  (8),  when  (8a)  is  p- dominant, 
is  described  in 

Theorem  1:  For  all  bounded,  measurable  ^»(t),  the  solution 
u(t)  of  (8)  is  asymptotic  to  sero  (limt  |nLu(t)  «  0)  for  all 
T  2  0  if  (8a)  is  p-dominant. 


The  validation  of  this  result  given  by  Barwell  in  [2]  is  more  tedious  than 
chat  found  next  in  our 

Proof:  Let  a  variable  subscripted  with  &  [with  I]  denote  the 
real  part  Cthe  imaginary  part 3  of  that  variable.  Then  the 
complex  scalar-valued  differential-difference  equation  (8a) 
is  equivalent  to  the  real  vector-valued  differential-difference 
equation 


pR  -’ll  K 

">1  +  pR  -’ii  rv'->' 

(10) 

L’i  p»J  Lt 

(t)  <Ij  qR  Ojfe-r) 

The  solution  of  this  equation  will  be  asymptotic  to  zero  for  all 
t  a  0  if  and  only  if  its  chsracteristlc  function 
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P(s,e”T*)  •  det 


(11) 


is  nonzero  in  the  dosed  right  half-plane  for  ell  t  2  0.  [4,5] 

Note:  A  superscript  *  denotes  (complex)  conjugete.  As  shown 
by  Ksaen  in  [6],  this  is  equivalent  to 


P(stz)  4  0  (Re{s}20,  |z|si). 


(12e) 


where 

P(s,z)  -  (s-p-qz) (s-p*-q*z) .  (12b) 

Nov,  for  |z|sl, 

Re(p+qz}  •  Re(p)  +  Re{qz)  s  Re(p)  +  |q|  <  0 
end 

Re{p*+q**}  -  Re{p*>  +  Re{q*z)  S  Re{p*)  +  |q*|  -  Rc{p}  +  |q|  <  0. 

These  two  reletions  imply,  respectively,  that  (s-p-qz)  and 
(s-p*-q*z)  cannot  become  zero  for  Re{s)  2  0  when  jz|  S  1. 

Therefore,  P<s,z)  cannot  bacooa  zero  for  Re{s)  2  0  when  |z|  si.  ■ 

Next,  let  u  ,  A  ,  and  u  denote  approximations  of  u(t  ),  u(t  )  and 
u(tn-t),  where  tft  ■  tQ-1+h  end  v  ■  x/h  for  some  h.  Clearly,  (8a)  with  the 
substitution  of  these  approximations  provides  just  one  relation  among  the 
three  variables  u  ,  u  ,  end  u  .  An  additional  two  Independent  reletions 

u  u  Q*V 


ere  needed 


A s  the  first  of  these  tvo  remaining  relations  we  shall  use  the  multi- 


step  (integration)  relation 


which  is  of  order  p  if  the  coefficients  and  0^  satisfy 


:i-«  at*° 


-  0  u-l . ?). 

Being  of  order  p  implies,  when  u(t)  is  sufficiently  differentiable,  that 


£i-«  Caiu<W“**i4<W3  •  W(^1)(ll)h5+1  +och^2]. 


where  u  <  [t  .  t  ]  and 
n 


Vi  *  l°±-*  uK^dAjJ. 


As  the  second  of  these  two  remaining  relations  we  shall  use  the  order  q 
Lagrange  (interpolation)  relation 


-  lU  V^v*/0' 


where  the  indices  a ^  (J-0, . . . ,q)  satisfy  Oic->* • *>o0  and  the  coefficients 


<j(v)  satisfy 


(-v)k-  j  (v)o ^-0  (k-0, . . .  ,q) . 


The  well  known  solution  of  (18)  is 


-  a.  +v 

Mv)  -  ■*  • 


I 


Being  of  order  q  lnpliee,  when  u(t)  is  sufficiently  differentiable,  that 


•<V*>  -  • 

■  +OCh'+2], 


where  w  «  Ct  ,  t  3  and 

nrW0  “q 


«i+i(v)  -  <-'-)5+1  -  ‘J-o 


q+1 


(20) 


(21) 


We  turn  our  attention  now  to  the  stability  versus  order  properties  of 
the  numerical  methods. 

Firstly,  with  respect  to  the  multistep-method,  herein  assumed  to  be  such 
that  l^m  ^C  and  are  relatively  prime,  we  have 


Definition  1 s  The  multistep-method  is  said  to  be  passive  if 

Rft{£i-K°i?,e+VIi— w6icK+1}  *  0  vc  e  |c|*i  a  rJ__Keic,c+1,‘o  .  (22) 

and 

s 

Definition  2  s  The  multistep-method  is  said  to  be  a-psssive 
(0  <  a  S  ir/2)  if 

*  »"«  VC  c  |c|si  a  lJ.^cB1c,C+1^0  .  (23) 

Obviously,  a  ir /2-passive  method  is  passive.  Note:  Passivity  of  a  method  is 
equivalent  to  it  being  A-stable  and  a-passivity  of  a  method  is  equivalent 
to  it  being  ACa]-stable.  The  research  of  Nevanllnna  and  Sipila  [7]  makes 
it  evident  that  a-passlve  methods  are  necessarily  implicit.  Furthermore, 
by  the  now  classic  Daiilqulst  Theorem  [8],  we  know  chat  the  order  of  passive 
methods  cannot  exceed  two.  Fortunately,  a-passlve  methods  (with  a  <  */2)  of 
order  exceeding  two  exist;  for  example,  the  backward  dlfferantiatlon  methods 


f 


I  *  .  .  V  • 
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of  Goar  [9,  chapter  113  are  a  sot  of  a-paaaive  methods— 'orders  one  through 
six. 

Secondly,  with  respect  to  the  Lagrange  method  we  have 

Definition  3:  The  Lagrange-method  is  said  to  be  passive  if 

SI  V  |c|  a  1.  (24) 

and 


Definition  4s  The  Lagrange-aethod  is  said  to  be  8 -passive 
(1  s  8)  if 

s  (25) 

Obviously,  a  1-passive  method  is  passive.  The  research  of  Strang  CIO] 

(See  also,  [11].)  discloses  that  La grange-methods  with  a  uniform  mesh 
(Oj  •  -A+j)  are  passive  when  -v  <  t-A+(q~l)/2,  -A+(q+l)/2]  for  q  odd  and 
-v  c  C-X+q/2-1,  -A+q/2+1]  for  q  even.  These  intervals  are  center  in  the 
larger  Interval  C-A,  -X+q]  spanned  by  the  interpolation  points.  A  Lagrange- 
method  with  a  uniform  mesh  will  be  called  a  uniform  Lagrange-method  and, 
when  X  is  chosen  such  that  -v  is  restricted  to  the  central  interpolation 
Interval,  it  will  be  called  a  centered  uniform  Lagrange-method.*  It  is 
evident  that,  if  a  centered  uniform  Lagrange-method  is  to  be  passive  for 
all  v  2  0,  then  the  order  cannot  exceed  two.  (This  limit  is  the  counter- 


*In  general,  a  mesh  is  uniform  when  “  -A+jl.  Obviously,  Strang's  result 

continues  to  be  correct,  but  with  respect  to  the  central  interpolation 
Interval  within  a  larger  mesh,  a  mesh  with  a  mesh-interval  of  t.  It  was 
convenient  for  the  results  to  be  presented  in  this  section  to  implicitly 
use  t“l. 


part  of  the  order  limit  on  e  passive  multis tep-me thod . )  Fortunately, 
because  ,,  (v)c°J  is  a  polynomial  in  v  and  it  is  bounded  for  all 
v  *  0,  provided  the  interpolation  points  (j»0,...,q)  sre  suitably  chosen 
and  for  |c|  a  1.  Thus,  a  Lagrange-method  of  any  order  is  6-passive. 

P-3TABILITY 

Our  initial  result  is  with  respect  to 

Definition  5:  The  multis tep-me thod /Lagrange-method  pair  (13) 
and  (17)  is  said  to  be  P-stable  if  the  (numerical)  solution 
of  (8)  by  (13)  and  (17)  for  all  x  2  0  and  for  any  fixed  positive 
h  is  asymptotic  to  zero  when  (8a)  is  p-doninant. 

We  now  offer 

Theorem  2:  The  multistep-me thod /Lagrange-method  pair  (13)  and 
(17)  is  P-stable  if  the  aultistep-method  is  passive  and  if  the 
Lagrange-method  is  passive. 

and  its 


Proof:  By  Definition  5,  (8a)  la  p -dominant.  It  therefore  follows 
by  Theorem  lt  that  the  solution  of  (8)  is  asymptotic  to  zero  for 
all  x  2  0.  As  noted  in  the  proof  of  that  theorem,  this  is  equiva¬ 
lent  to 

P(a,*)  +  0  (Re{s)  2  0,  | z |  &  1), 


(26a) 
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where 

P(s,z)  -  (s-p-qz) (s-p-qz) .  (26b) 

In  that  proof  we  validated  (26a)  by  shoving  that 

R(s,z)  i*  0  (Re{s)  2  0,  | z |  Si),  (27a) 


where 

R(s,z)  *  s-p-qz.  (27b) 

Nov  consider  the  set  of  discrete  time  equations  (8) ,  in  which  the 
variables  have  been  replaced  by  their  previously  noted  approxima¬ 
tions,  with  (13)  and  (17).  If  the  solution  is  to  be  asymptotic 
to  zero,  then  the  characteristic  function  (easily  shown  to  be) 
ho(c)RCp(C)/bo(c),  0(C) 3  must  be  nonzero  for  |c|  2  1,  where 
p(C)  -  lJ,.|Ca1c'e+i.  a(C)  -  and  9(c)  -  (v)c°J . 

That  this  is  true  for  C  such  that  |d  2  1  and  o(c)  +  0  follows 
from  (27a)  with  (22)  and  (24).  For  the  case  of  C  such  that 
|c{  2  1  and  o(c)  •  0,  the  characteristic  function  equals  p(c), 
which  is  nonzero.  ■ 


The  orders  of  the  multistep-method  and  of  the  Lagrange-method  are 

related  to  the  discretization  error  as  follows:  If  q  2  p-1,  if  Un+i  " 

u<tn+i)  +0Ch^l;i  for  1  €  . a5>\{°>.  «nd  if  u(t)  is  p+1 

times  continuously  differentiable  for  t  €  [tn_<>  tn^u^tn+0  »  tn+o-^*  t*ien 
—  o  q 

u  -  u(t  )  +OChp+13.  We  hereafter  assume  that  q  2  p-1  and  shall,  as  a 
n  n 

consequence  of  this  observation,  refer  to  p  as  the  order  of  the  multistep- 
method  /Lagrange-method  pair.  As  a  consequence  of  Theorem  2  and  of  previous 
observations,  we  have 


Theorem  3 :  The  order  of  a.  necessarily  P-s table,  passive 
multistep-method/passlve  Lagrange-method  pair  cannot  exceed 


If  we  should  assume  that  q  2  p,  then*  additionally,  the  principal 
error  term  would  be  dominated  by  the  principal  error  term  of  the  multistep- 
method.  This  being  the  situation,  a  solution  process  for  differential- 
difference  equations  based  on  a  set  of  passive  (hence,  P-stable)  multistep- 
method  /Lagrange-method  pairs  could  be  created  by  augmenting  a  solution 
process  for  differential  equations,  based  on  the  set  of  multistep-methods, 
by  interpolators  from  the  set  of  Lagrange-methods .  The  error-control — 
hence,  also  the  step-control— procedure  would  not  need  to  be  changed. 

And,  the  order-control  procedure  could  remain  unchanged,  but  with  only  an 
upper  limic  of  two  on  the  order. 


PCa.B 3-STABILITY 

The  order  constraint  imposed  by  Theorem  3  can  be  circumvented  by  in¬ 
voking  other  methods  and/or  by  considering  alternate  stability  types.  We 
consider  the  latter  in  this  section,  beginning  with 


Definition  6 :  The  multistep-method/Lagrange-method  pair 
13)  and  (17)  is  said  to  be  P(a.S]-stable  if  the  (numerical 


solution  of  (8)  by  (13)  and  (17)  for  all  t  i  0  and  for  any  fixed 


osltlve  h  is  asymptotic  to  zero  when 


^ijdr/2-o) 


where  J  ■  /-I. 
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Proof:  The  validity  of  (28)  by  Definition  6  implies  the  dif¬ 
ferential-difference  equation 

*<t)  -  +  qv(t-t)  (29) 

is  {•ge±^*^2"’a^p}-dominant.  Therefore,  by  Theorem  1,  the  solution 
of  (29)  for  any  bounded,  measurable  initial  function  is  asymptotic 
to  zero  for  all  t20.  This  implies  and  is  implied  by  its  character¬ 
istic  function 

be in*  nonzero  for  Re{o}  2  0  end  for  ell  t  2  0.  As  previously  noted, 
this  is  equivalent  to 

Q (0,0  *  0  (Rfe(o)  >  0,  |(|  i  1)  (31a) 

where 


<Ko.O  -  Co-|e±J(w/2”a)p-qUCa-|e±j(lt/2“a)p*-q*c3 


(31b) 
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This  Implies  that  both  fsctors  must  be  nonzero  £or  Re{o}  a  0 

end  jcj  £  1.  Since  multiplication  of  either  factor  by^an  entire 

function  does  not  alter  this  property,  ve  have  by  Implication 

(upon  multiplying  the  left  factor  by  (w^2-a)  and 

,  .  6«+J <»/2-d>o  <Ild  ,  .  chac 

R(s,z)  +  0  (|arg{s}|  £  w-o,  |z|  £  6),  (32a) 

where 

R(s,z)  »  s-p-qz  .  (32b) 

This  same  function  appeared  in  the  proof  of  Theorem  2,  but  was, 
there,  nonzero  on  a  smaller  domain.  (See  (26).)  Now,  as  in  the 
proof  of  Theorem  2,  ho(c)R£p(c)/h0(c),  0(c)],  the  characteristic  func¬ 
tion  in  the  solution  of  (8)  with  (13)  and  (17),  must  be  nonzero 
for  |c|  21.  (The  functions  p,  9,  and  0  are  as  defined  in  the 
proof  of  Theorem  2.*)  By  definition  2,  |arg(p(c)/ho(c)}|  *  *-<* 
over  the  region  of  c  such  thet  (d  2  1  and  o(c)  i  0  and,  by  Def¬ 
inition  4,  the  modulus  of  0(c)  is  bounded  by  S  over  the  region 
Id  2  1.  Our  result,  for  C  such  that  |c|  2  0  and  o(c)  i  0,  now 
follows  from  property  (32a).  For  the  cese  of  c  such  that  |c|  2  1 
and  o(c)  ■  0,  the  characteristic  function  equals  p(c),  which  is 
nonzero. 

Since  there  exist  a-passive  mult is tap-methods  (such  as  the  backward 
differentiation  multistep-methods)  of  order  exceeding  two  and  since  every 


*ln  the  first  half  of  this  proof  a  and  C  were  used  as  transition  variables, 
with  no  relationship  to  the  meaning  ascribed  to  them  hereon  and  in  the 
proof  of  Theorem  2.  We  trust  that  no  confusion  has  ensued  or  will  ensue 
from  doing  this. 
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Lagr ange-ne thod  is  bounded,  it  follows  that  P[a,0]-stable  multistep-method/ 
Lagr angetue thod  pairs  exist.  For  uniform  Lagrange-methods  a  0  valid  for 
all  v  2  0  is  easily  obtained  for  q  >  2  as  the  maximum  of  £j«ol4j(v)l  with 
respect  to  -v  <  C-X+(q+l)/2,  -X+q3  for  q  odd  and  -v  e  C-X+q/2+1,  -X4q]  for 
q  even.  In  Table  1  we  display  order-by-order,  for  orders  1  through  6,  the 
a  and  0  values  for  the  paired  backward  differentiation  multlstep-methods 
and  uniform  Lagrange-methods. 


Table  1  P[a,0]-s table  backward 

differentiation  multlstep- 
me thod /uniform  Lagrange- 
method  pairs. 


The  constraint  (28)  on  p  and  q  associated  with  a  P[a,0]-stable  method 
is  illustrated  in  Figure  1.  The  value  of  p  must  lie  within  the  sector  when 
that  of  q  lies  within  the  disk  of  radius  p. 


Figure  1  p  and  4  regions  for  e 
P[o,0]-stable  pair. 

COMPOSITE  MULTISTEP-METHODS 

In  this  section  we  turn  our  attention  to  other  aethoda ;  in  particular 
we  focus  on  composite  multistep-methods  C12,13]  as  an  alternative  to  multi 
step-methods.  Such  methods  are  characterized  by  the  relation 

•  -  9. 


•.  *  .•  * 
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are  1-vectors  of  consecutive  blocks  of  t  contiguous  epproxisiants  to  the 
solution  of  (8)  and  where  A.  (I«-1C, . . .  ,0)  and  B_  (I*-K, . . . ,0)  are  (1*1)- 

*  X  m  A 

■a trices  which  satisfy 

-  0  (34a) 


and 


4I— K 

* 

h 

[u-nJ 

m 

• 

e 

• 

‘  Si 

jtu-n1"1 

e 

e 

e 

< 

» 

_C(I-l)i3j_ 

jc(i-i)«J“l_ 

j 

0  (j-l,...,p). 


(34b) 


As  for  multistep-methods ,  p  is  the  order.  Mote:  Ve  assume  herein  that  the 
composite  multistep-methods  have  zero  defect;  that  is,  that  both  Aq  and  Bq 
are  of  full  rank,  rank  1.  Mow,  with  respect  to  the  composite  multistep- 
method  we  have 


Definition  7 :  The  composite  multistep-method  is  said  to  be 
q-passive  (0  <  o  $  rr/2)  if 

<*«(C£^KAICK+I]-XCl5..KBICK+I]}l‘0  (!c|il,  |arg{-X>|<«).  (35) 

% 

This  definition  relates  to  those  for  passivity  and  a-passivlty  of  a  multi- 
step-method  (composite  multistep-method  with  1-1)  in  the  following  way: 
detfE^'gB^c***}  is  not  identically  zero  because  Bq  Is  of  full  rank.  Therefore, 
4at([Ij^1^IcK+l3“1CEj-_KAICK+l]-AI}  is  not  zero  for  c  such  that  |c|  *  1  and 
det { I ^  **  0  *or  lar8t”^}|  *  «• 


•re 


This  implies  that  the  eigenvalues  of  CI°__1cBicK+I]*1[eJ__kA1i;K+I] 
algebraic  function  of  Z  whose  arguments  are  contained  In  the  Interval 
C-(w-a),(w-a)]  for  all  c  such  that  Jc|  2  1  and  dottE^^c**1}  0.  This 
la  Just  property  (23)  in  the  definition  of  a-pasaivlty  when  1-1.  It  Is 
equivalent  to  property  (22)  In  tha  definition  of  passivity  when  1-1  and 
a  -  */2. 

We  now  offer 

Theorem  5 :  The  composite  gultistep-method/Lagrange-method  pair 
(33)  and  (17)  with  -  £^1  la  PCs. 61-stable  if  the  composite 
multla ten-method  is  a-passiva  and  if  the  Lagrange— method  Is 
6-passive.* 


and  Its 


Proof:  The  first  portion  of  the  proof  of  this  theorem  Is  that  for 
Theorem  4  through  (32).  We  take-up  this  proof  from  that  point. 

The  numerical  solution  of  (8)  by  (33)  and  by  (17)  with  o^  -  £^1 
engenders  the  difference  equation 

j-o‘3  <v>  1  >-°  •  <*> 

which  has 

det£ClJ<fc.KlICK+I>hClJfcKBICK+I3Cp+ql]Hj«j(v)c5J3}  (37) 


* Definitions  of  the  stability  types  when  a  composite  multistep-method  is 
used  as  the  integrator  wars  not  given  as  they  would  be  trivially  different 
from  Definitions  S  and  6  wherein  just  a  multistep-method  serves  as  the 
integrator. 
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as  its  characcarlstic  function.  Zf  the  numerical  solution  Is 
to  be  asymptotic  to  zero,  then  (37)  must  be  nonzero  for  |c|^l. 
Firstly*  1st  us  considsr  those  C  such  that  |c|  a  1  and 
det{Ij-_Kg1cK+1)  i  0.  Then  (37)  Is  equivalent  to 


.  /!r«.0  „  K+I.-1..0  .  »I, 


■fcCp*qIj-0Sj(v)C^  31)1*0.  (38) 

Now*  1st  cA(C)  (1-1,..., O  denote  the  eigenvalues  -  algebraic 
functions  of  C  -  of  ®wn»  ^®) 

may  be  replaced  by 

^(O-p-qlj^Wc^  *  0  \Ull . 1».  (39a) 

or*  equivalently, 

RCa^O/h.  «(Cl/1)3  i  0.  (1*(1 . *».  (39b) 

As  previously  noted,  we  have  {arg  |sv-o  (lc{l,...,l», 
and,  because  |«(0|  *(•«*  have  {•(cl^l,)|  *  0.  It  therefore  fol¬ 
lows  from  (32)  that  property  (39)  la  true  for  C  such  that  |c|  a  1 
and  0«t{lJ_ g?i5K+IJ  **  °*  I**  «■»  ®ow*  ••condly  consider  those 

C  such  that  jcj  a  1  and  0«t(Zj-..K8I5K+I}  "  ®*  In  thi*  ““  (37) 
la  equivalent  to  det(adJ{lJ--KBICK+I>ClJ..KAICIW‘1])  *  0.  But  this 
Is  an  Immediate  consequence  of  (35)  for  such  values  of  c.  ® 

If  for  the  composite  multistep-methods  we  were  to  use  those  reported 
by  Bickart  and  Plcel  [14]  and  If  for  the  Lagrange-methods  we  were  to  require 
a  uniform  mash  (mash  Interval  1,  rather  than  the  previous  1),  then  we  would 
have  a  set  of  Pfa,0]-stable  composite  multistep-method/Lagrange-method 
pairs  with  the  a  and  0  values  displayed  in  Table  2.  The  Blckart-Ficel 


methods  are  one-step  methods  for  which  maximum  order  was  sacrificed —  the 
order  la  one  lass  than  the  maxiimm  possible— to  achieve  Improved  nusterical 
solution  properties  for  very  large  h. 


Table  2  PCa,g]-stable  Bickert- 

Picel  composite  multistep- 
method  /uniform  Lagrange- 
method  pairs 


If  ve  were  to  use  the  maximum  order  one-step  composite  multistep-methods, 
then  we  would  have  a  set  of  P[ct8]-stabla  pairs  with,  in  particular,  o«90.0° 
for  order  2  et  1*1  through  order  7  at  1*6.  C 15—163 


COMPOSITE  LAGRANGE-METHODS 

Interpolation  on  a  uniform  mesh  with  an  interval  of  i  rather  than  1  has 
a  principal  error  term  which  is  larger  by  a  factor  of  If  l  is  large, 

then  the  principal  error  term  of  the  Integrator,  which  dominates  that  of  the 
Interpolator  when  q  2  p,  may  not  be  in  fact  significantly  greater  than  that 
of  the  Interpolator.  This  could  have  a  deleterious  effect  on  error  control 
in  a  solution  process  using  an  approximation  to  the  principal  error  term  of 


the  integrator  aa  the  error  aeasure.  This  is  the  reason  we  here  remove  the 
constraint  Oj  ■  and  consider  the  resulting  composite  Lagrange-methods . 

With  respect  to  the  block  of  solution  values  Uj,  the  archtype  equation 
(8a)  establishes  the  relation 


ij  -  PSj  + 


with 


5j-v 


ttJi-l-v 

e 

e 

e 

_u(J-l)i-v_ 


(40) 


The  interpolation  relation  (17)  applied  to  each  element  of  yields  the 
composite  interpolation  relation 


0. 

-J-v 


ri-o-i(w>- 


I+EI’ 


(41) 


where  each  row  of  the  (block  row)  matrix  [4-;  •  •  •  !  AQ]  has  q+1  nonzero  elements 
for  almost  all  v,  the  coefficients  A^(v)  of  (17).  For  example,  when  i**3 , 
q-4,  and  -  (-8,  -6,  -5,  -3,  -2),  then  Q-3,  (I0,I  ,1  ,£  )  - 

(“3,  -2,  -1,  0),  and  the  have  the  nonzero  structure  displayed  next: 


0 

0 

X 


It  is  quite  evident,  based  on  (17)  for  each  of  the  constituent  relations. 
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(i-2 . 

(i-2 . t.U-1 . (1-1))). 

*v 


If  each  of  the  constituent  relations  were  based  on  a  different  Interpolation 

a 

relation  of  the  form  of  (17) ,  then  we  could  say  only  that  CAq‘ ••••Aq]  would 
have  q+1  nonzero  eleaents  per  row  for  almost  ell  v  end  that 

-  0  (1-2 . l,(j-l . (1-1))).  (42) 

Note:  q  could  of  course  be  different  for  each  row,  a  ease  we  will  not 
develop  la  this  paper.  Coaposlte  Interpolation  relations  (or  composite 
Lagrange-aethods)  for  which  (42)  is  true  are  said  to  be  cyclic.* 

Since  we  ere  solving  for  the  block  of  solution  values  U^,  the  1-th 
relation  could  depend  on  all  of  the  values  of  U^,  not  just  the  1-th  and  those 
preceding  It.  So,  for  the  i-th  constituent  relation  the  constraint  on  the 
can  be  relaxed,  becoming  l-l  i  o-  >***>o0  (1-1,..., 1).  The  numerical 

solution  of  (8)  by  (33)  and,  in  this  general  setting,  (41)  engenders  the 
difference  equation 

1 1— P5lf+l+qE J-04 J  ^  -N+I+I j ^  *  “  2* 

which  has 

<*«<ClJ^IC4IC,C+I]-hCl5^KBICIC+I3CpI+qEj.0AJ(v)cEJ)}  (44) 


*Such  methods  are  said  to  be  cyclic  because,  when  one  is  paired  with  a  cyclic 
composite  multistep-method  C 173 ,  the  constituent  equations  of  the  resulting 
solution  process  ean  be  solved  cydidy  for  the  successive  solution  values 
In  e  block  of  solution  values. 
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as  Its  characteristic  function.  If  the  numerical  solution  is  to  be  asymptotic 
to  sero,  then  (44)  must  be  nonzero  for  jcjil. 

He  have  no  analytic  results  on  the  stability  properties  of  composite 
aultlstep-method/ composite  Lagrange-method  pairs  to  report  in  this  paper. 
However,  for  a  few  eases,  we  have  obtained  stability  boundary  plots  when 
v  €  (0,1)  to  illustrate  what  might  be  expected  of  such  pairs.  He  used  the 
Blckart-Plcel  composite  multistep-methods  in  conjunction  with  composite 
Lagrange-methods  having  Aj  with  the  nonzero  structure  displayed  next: 


“  :]  a 

“  **-R :  SI  *-'•["  si 

Lx  x  xj  Lo  0  oj 

1-4  An  -  fx  X  X  flTJ  A,  -  fx  X  0  o' 
U  XXOQ  1  OXOX 

0  X  X  0  0  0  X  X 

JO  X  x  xj  [o  0  0  X 


•  r°  ° 
t  0  0 


0  0  0  0 
X  0  0  0 
X  0  0  0 
X  0  0  0 


The  corresponding  plots,  obtained  by  numerically  solving  the  characteristic 
equation*— ’characteristic  function  equated  to  zero— with  q-1  and  v-1/2,  1, 
3/2,..., 1-1/2,  are  displayed  in  Figures  2  through  4.  Hlth  respect  to  these 
plots,  we  can  at  best  expect  these  methods  to  be  p[90*,  g] -stable  with 
B*l,  1.56,  3.69  for  £-2,3,4  (respectively). 


71|ur«  ]  Stability  boundary  plots:  1*3 
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CONCLUDING  DISCUSSION 

We  have  herein  introduced  the  properties  of  P-stability  and^P[a,g]- 
stabllity  for  integration/ interpolation  pairs  upon  which  to  base  a  process 
for  solution  of  retarded  differential-difference  equations.  We  considered 
various  pairs  with  respect  to  these  properties;  In  particular,  we  Introduced 
the  pairing  of  a  composite  multistep-method  with  a  composite  Lagrange- 
method.  In  this  instance  we  could  present  only  limited  non-analytic  data 
on  stability  attributes.  A  larger  base  of  such  data  led  us  to  implement  a 
variable-order,  variable-step  solution  process  based  on  a  set  of  composite 
multlstep-method/composite  Lagrange-met hod  pairs.  The  listing  of  a  FORTRAN 
coded  version,  together  with  supporting  documentation,  is  to  be  found  in 
[18].  The  listing  and  user  manual  of  an  APL. coded  version  are  provided  in 
C19].  A  simple  illustration  of  the  latter,  drawn  from  [2],  is  pro¬ 
vided  in  Plate  1. 
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Plate  1  Example  of  DDE  solver  of  [19] 


DAVID  J.  NOLTING,  Dept  of  Methenatlcs,  U.  S.  Air  Force  Academy, 
Colorado,  80840  and  DAVID  J.  RODABAUGH,  Lockheed  -  Burbank,  Ca 
91520.  Stiffly  Stable  Linear  Multistep  Methods.  Abstract. 

Currently  popular  codes  for  the  solution  of  stiff  ordinary  differential 
equations  employ  the  backwards  difference  formulae  (BDF).  Notwithstanding 
the  computational  advantage  of  the  BDF,  they  suffer  large  regions  of  in¬ 
stability  In  the  left  half  plane  for  orders  four  through  six  and  are  not 
Abatable  for  orders  greater  than  six.  This  roughly  points  out  the  need 
for  more  robust  methods. 

Desirable  properties  of  linear  multistep  methods  (LMM),  such  as  size 
of  stability  regions,  can  be  optimized  by  viewing  those  properties  as 
functional  values  and  the  LMM  possessing  those  properties  as  points  in  a 
domain  space.  This  study  conducts  such  an  optimization  numerically. 

The  concept  of  A(a,r) -stability  is  introduced  for  stiffly  stable  LMM. 

It  recognizes  the  need  for  large  regions  of  absolute  stability  in  the  left 

half  plane  and  the  need  for  a  region  of  accuracy  about  the  origin  defined 

by  the  region  of  relative  stability.  An  economical  means  of  determining  the 

region  of  relative  stability  is  developed  and  used.  Nearly-optimal  A(a,r)- 

stable  implicit  LMM  are  found  for  orders  four  through  six  for  a  variety  of 

classes  determined  by  fixed  error  constants  C  .,/a(l). 
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STIFFLY  STABLE  LINEAR  MULTISTEP  METHODS 


1.  Introduction 

Consider  the  initial  value  problem 


y'  •  f (xty)t  xe[a,b],  y( a)  -  t/Q 


(1) 


where  y,  y Q,  and  f (xty)  are  in  Rn  and  sufficient  conditions  are 
placed  on  f  to  ensure  a  unique  solution  exists.  In  the  past  fifteen 
years  much  research  has  bean  devoted  to  the  development  of  numerical 
methods  for  obtaining  solutions  to  problems  (1)  of  the  class  referred 
to  as  stiff  problems.  Commonly  used  numerical  methods  are  linear 
k-step  methods  of  the  form 


k-1 
£  a 
i— 1 


i 


Vi  + 


k-1 
h  £ 
i— 1 


0, 


where  *  -1  and  +  I  **  M®8*  popular  codes  which  employ 

IMM  for  the  solution  of  stiff  problems  depend  exclusively  on  the  back¬ 
ward  difference  formulas  (BDF)  [3,  p.217].  These  methods  suffer  large 
regions  of  instability  Jn  the  left  half  plane  and  are  not  AQ-stable  [1] 
for  orders  greater  than  six.  This  suggests  much  improvement  is  possible. 

Grigorleff  and  Schroll  [4]  and  Kong  [7]  have  given  constructive 
proofs  which  show  the  existence  of  A(a)-stable  [12]  methods  of  arbitrar¬ 
ily  high  order  with  a  arbitrarily  close  to  ir/2.  However,  searches  for 
practical  methods  successful  in  the  solution  of  stiff  problems  have  made 
little  progress  [7,  11,  6,  5,  2].  None  of  these  Investigations  have 
resulted  in  methods  which  perform  significantly  better  than  BDF. 
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2.  Defining  the  problem. 

There  are  several  properties  of  LMM  which  appear  decisive  in 
determining  the  performance  of  a  LMM  in  the  solution  of  a  stiff  problem. 

To  conduct  a  search  for  optimal  methods  we  need  to  isolate  these  proper¬ 
ties,  determine  a  useful  measure  for  each  property,  and  define  our  object 
function  in  terms  of  these  measures.  The  region  of  absolute  stability  is 
of  prime  interest  because  of  the  need  to  maintain  stability  for  the  com¬ 
ponents  resulting  from  the  eigenvalues  with  negative  real  part  and  large 
magnitude.  The  angle  a  is  a  measure  of  the  absolute  stability  region  which 
is  widely  used. 

The  region  of  accuracy  about  the  origin  is  important  because  the  com¬ 
ponents  of  the  solution  resulting  from  eigenvalues  near  the  origin  are 
dominant  in  the  solution  and  their  accuracy  must  be  of  concern.  A  natural 
measure  for  this  region  is  the  radius  of  relative  stability.  A  knowledge 
of  the  relative  stability  characteristics  is  essential  before  we  attach 
meaning  to  the  numerical  solution. 

To  illustrate  the  necessity  of  measuring  relative  stability  we  solve 
an  example  problem  in  35-dlgit  precision  with  the  5th  order  Adams-Bashf orth 
(A-B)  method  and  with  a  7th  order  explicit  near-optimal  method  [9]  of 
better  relative  stability  characteristics.  The  problem  considered  is 

{/'  ■  -16 y,  y(0)  -  1,  xe[0,3]. 

We  use  a  stepsize  of  h  ■  0.01.  Thus  we  have  hA  *  0.16  which  is  inside  both 
methods’  region  of  absolute  stability.  However  it  is  well  outside  the  A-B 
5th  order  relative  stability  region  and  near  the  boundary  of  relative  sta¬ 
bility  for  the  7th  order  method.  This  problem  gives  us  an  example  of  what 
can  happen  when  we  forget  about  relative  stability  in  the  left  half  plane. 
The  results  are  given  below  in  table  1. 
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TABLE  1 


Illustration  of  the  Importance  of  relative  stability 


! 


Step 

No. 

True 

Solution 

A-B  5th  Order 

7th  Order  Near-Optimal 

Calculated 

Actual  Error 

Calculated 

Actual  Error 

0 

0. 1000Q+01 

0. 1000Q+01 

0.0 

0 , 100GQ+01 

0.0 

50 

0.3355Q-03 

0.3357Q-03 

-0.1988Q-06 

0.3354Q-03 

0.6280Q-07 

100 

0.1125Q— 06 

0.3001Q-06 

-0.1875Q-06 

0.1125Q-06 

0.8515Q-10 

150 

0.3775Q-10 

0.1108Q-06 

-0.1108Q-06 

0.3769Q-10 

0. 6116Q— 13 

200 

0.1266Q-13 

0.6541Q-07 

-0. 6541Q-07 

0. 1263Q-13 

0.3401Q-16 

250 

0.4248Q— 17 

0.3862Q-07 

-0.3862Q-07 

0,423 IQ-17 

0.1686Q-19 

300 

0.1425Q-20 

0.2280Q-07 

-0.2280Q-07 

0.1418Q-20 

0.7640Q-23 

If  we  had  solved  this  problem  with  the  A-B  5th  order  method  and  desired  to 
follow  the  solution  to  this  problem  (possibly  a  component  of  a  larger  system) 
until  the  solution  fell  below  10~10  for  example,  we  would  find  it  necessary  to 
continue  to  step  825.  Whereas  in  fact,  and  as  detected  by  the  relatively  stable 
7th  order  near-optimal  method,  we  could  terminate  calculation  after  step  150. 

In  this  case  and  others  like  it.  Ignoring  the  relative  stability  characteristics 
of  a  method  can  be  a  very  costly  choice.  The  relative  error  for  the  A-B  solution 
in  Table  1  after  300  steps  is  1.6000Q+13  and  for  the  near  optimal  method  is 
5.3610Q-03.  Note  that  the  A-B  solution  is  tending  to  zero,  which  evidences  the 
methods'  absolute  stability  at  hA  *  -0.16,  but  not  nearly  so  fast  as  the  solution 
itself.  In  fact  it  tends  to  zero  so  slowly  that  the  calculated  solution  values 
are  essentially  meaningless. 

These  considerations  led  to  the  definition  of  A(oi,  r)- stability  given  below. 

Definition:  A  LMM  is  said  to  be  A(a,  r) -stable  if  the  method  is  A(o0- 
stable  with  regard  to  its  region  of  absolute  stability  and  is  relatively  stable 


3 


within  the  disk  of  radius  r  about  the  origin. 

It  is  this  definition  which  we  implement  in  our  search  for 
stiffly  stable  LMM.  It  seems  of  interest  then  to  know  how  far  a 
and  r  can  be  extended  for  a  fixed  value  of  the  error  constant.  We 
report  the  results  of  such  an  investigation  in  this  paper  and  find 
methods  nearly  optimal  with  regard  to  these  desired  properties. 

Further,  in  comparison  we  find  these  near-optimal  methods  perform 
successfully  as  we  would  expect  from  the  stability  and  error  measure¬ 
ments  applied.  A  method  which  is  A(ot,  r)-stable  will  be  relatively 
robust  depending  upon  the  size  of  ct  and  r.  By  that  we  mean  it  should 
give  good  results  on  a  large  variety  of  both  stiff  and  non-stiff 
problems. 

Let  c(n,m)  be  the  class  of  all  nth  order,  m-step  correctors. 

We  choose  the  class  C(n,  n)  for  our  search  of  optimal  methods.  The 
corrector  search  is  posed  as  a  numerical  optimization  problem.  Our 
object  function  for  the  optimization  is  defined  as  a  linear  combination 
of  a  and  r. 

Results  and  Comparisons 

Defining  the  object  function  as  a  linear  combination  of  a  and  r 
increased  the  scope  of  the  optimization  since  then- our  interest  extends 
to  the  effect  of  taking  different  linear  combinations.  In  doing  so  we 
find  a  relationship  existing  between  a  and  r,  corresponding  to  maximal 
values  of  different  linear  combinations.  (Different  relationships  exist 
for  different  values  of  the  error  constant  ^/a(l).)  The  two  proper¬ 
ties  are  inversely  related  but  not  linearly  so.  For  example,  the 
following  relationships  exist  within  0(4,4). 
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radius  of  relative  stability 


Figure  1.  a  vs.  r. 

The  three  curves  result  from  fixing  the  error  constant, 

C  j/o(l) ,  at  the  values  given  adjacent  to  the  curves.  Notice  the 
curves  seem  to  approach  the  limiting  a-value  of  -rr/2  for  larger  values 
of  the  radiu3  as  the  error  constraint  is  relaxed.  This  leads  one 
to  suspect  these  curves,  corresponding  to  values  of  C  ,,/a(l)  in 

p+1 

(O,00) ,  fill  in  the  area  under  the  line  a  ■  tt/2  and  to  the  left  of 


the  line  r  »  rQ,  where  rQ  is  the  largest  radius  of  any  method  in  the 
class  C(4,4).  An  estimate  for  the  value  of  rQ  is  provided  By  the 
work  of  Thompson  and  Rodabaugh  [10],  where  they  report  candidates  for 
rQ  values  for  the  classes  CCn,  n-1),  4  <_  n  9.  They  obtained  these 
values  By  a  numerical  optimisation  with  no  constraint  on  the  error 
constant.  We  did  not  investigate  thoroughly  for  all  orders  and 
error  constants  the  portion  of  the  curve  defined  by  linear  combinations 
in  which  the  radius  was  weighted  much  more  than  alpha.  The  methods 
in  this  portion  of  the  curve  are  expensive  to  find,  and  of  little 
value  in  the  solution  of  stiff  problems  because  of  their  poor  absolute 
stability  properties.  Kong  [7]  considered  only  absolute  stability, 
and  therefore  his  results  define  the  upper  extent  of  the  curve  on  the 
alpha  axis.  The  optimisation  runs  for  these  methods  are  inexpensive, 
however,  they  also  are  of  little  value  to  this  investigation  because 
of  their  poor  relative  stability  properties.  For  orders  greater  than 
four  we  concentrate  our  effort  in  the  region  about  and  Just  to  the 
left  of  the  point  where  the  curve  starts  dropping  off  most  rapidly. 

This  region  of  the  curve  yields  methods  which  pair  values  of  a  and  r 
in  a  way  least  costly  to  either  property. 

Several  methods  obtained  from  the  investigation  are  described 
here  for  orders  four  through  six.  The  properties  of  the  second  order 
trapezoidal  rule  and  the  third  order  BDF  suggest  little  or  no  improve¬ 
ment  possible  below  fourth  order.  Since  the  BDF  are  members  of 
C(n,  n)  and  are  used  extensively  in  .stiff  codes,  we  use  them  for  com¬ 
parison.  We  choose  a  selection  of  near -optimal  methods  with  error 
constants  cp+j/<70-)  of  -0.2  and  -0.5  for  fourth  order,  -0.4  and  -0.8 


for  fifth  order,  and  -0,5  for  sixth  order.  Their  stability  pro¬ 
perties  are  outlined  in  Table  2. 


r-> 


0 


TABLE  2 

Stability  Properties  of  Near-Optimal  Stiff  Methods. 


B 


a 


Order 

Alpha 

Radius 

Waa> 

4 

1.481 

0.192 

-0.200 

1.414 

0.471 

1.377* 

0.650 

4 

1.535 

0.142 

-0.500 

1.511 

0.294 

1.445 

0.514 

5 

1.431* 

0.092 

-0.400 

1.338 

0.359 

1.259 

0.497 

5 

1.485 

0.077 

-0.800 

1.463 

0.155 

1.394 

0.463 

6 

1.321* 

0.121 

-0.900 

1.284 

0.299 

0.435 

*  Indicates  use  in 

test  runs  referred 

to  Table  4. 

For  comparison  we  give  corresponding 

informat  ion 

for  the  BDF 

in 

Table  3  below. 

• 

TABLE  3 

Stability  Properties  of  the 

BDF 

Order 

Alpha 

Radius 

4 

1.280 

0.484 

-0.200 

5 

0.905 

0.302 

-0.167 

6 

0.311 

0.130 

-0.143 

1 


The  kth  order  BDF  has  an  error  constant  of  1/  Ocfl) .  The 
severity  of  this  restriction  on  the  error  constant  no  doubt  causes 


the  loss  of  A^-stability  for  the  higher  order  BDF.  Notice  for  each 
order,  the  near-optimal  methods  have  considerably  greater  regions  of 
relative  and  absolute  stability.  The  effect  of  the  larger  error 
constants  is  nullified  by  the  capability  to  increase  the  order  with 
no  accompanying  restriction  on  alpha.  For  example,  if  we  compare 
the  near-optimal  sixth  order  A(l. 284,  0.299)  -stable  method  from 
Table  2  with  the  fourth  order  BDF,  it  is  the  case  that  the  problem 
Independent  part  of  the  error  term  for  the  near-optimal  method  will 
be  less  than  that  of  the  BDF  for  stepsizes  less  than  0.471.  This 
particular  comparison  does  not  involve  a  sacrifice  in  the  permissi¬ 
ble  values  of  alpha.  In  other  similar  comparisons  we  could  even 
realize  a  gain  in  the  permissible  values  of  alpha. 

Demonstration  of  methods  obtained. 

We  note  that  an  increase  in  the  error  constant  accompanying 
methods  with  higher  values  of  alpha  is  a  negative  aspect  that  can  be 
controlled.  However,  an  inferior  value  of  alpha,  such  as  possessed  by 


the  fifth  and  sixth  order  BDF,  severely  disables  a  method.  We 
illustrate  this  fact  by  solving  the  following  two  stiff  systems  of  the 
form  y' (t)  *  Ay(t)  where  A  is  a  constant  4x4  real  matrix. 
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Problem  2  (P2 ) 


y'  -  Ay,  t£[0,5], 

1 — 

yCO)  -  C2. 

0,  0.0, 

j-1  0 

100 

0 

A  0  “1 

0 

100 

A "  ;  o  o 

-100 

-250 

i  0  o 

250 

-100 

Table  4  indicates  the  methods  uned  on  each  of  the  problems.  A 

constant  stepsize  of  h  *  0.005  was  used  for  each  of  the  solutions 

throughout  the  interval  [0,5],  Results  of  the  calculations,  as 

well  as  coefficients  of  the  methods  used,  are  given  in  the  appendix. 

All  calculations  were  carried  out  on  an  Amdahl  370/V7  in  35-digit 

—78 

precision.  Numbers  less  than  approximately  10  in  magnitude  are 
represented  as  0.0. 

TABLE  4 


Order  of 
Method 

Method  Used 

Problem 

4 

A(1.377,  0.650) -Stable 

PI 

4 

BDF 

PI 

5 

A(1.431,  0.092) -Stable 

P2 

5 

BDF 

P2 

6 

A(1.321,  0.121)-Stable 

P2 

6 

BDF 

P2 

Referring  to  the  appendix  we  see  the  sixth  order  near-optimal 
method  solved  problem  P2  accurately  whereas  the  fifth  order  EOF  was 
unstable.  Since  these  computations  were  completed  we  have  found  a 
seventh  order  method  which  also  solved  problem  P2. 

Lambert  [8,  p.479]  indicates  an  Interest  exists  in  the  use  of 
stiff  methods  for  non-stiff  problems.  With  their  large  regions  of 
accuracy  about  the  origin  these  near-optimally  A(a,  r)-stable  methods 
should  be  ideally  suited  for  this  purpose.  In  test  runs  comparing 


these  methods  to  AdamsTMoulton  methods,  ue  solved  non-^stiff 
problems  with  a  method  of  one  order  higher  than  the  Adams- 
Moulton  method  used,  and  obtained  a  smaller  actual  error. 

The  larger  error  constants  of  these  methods  is  more  than 
offset  by  using  a  method  of  one  order  higher.  Using  a 
method  of  higher  order  is  permitted  by  the  larger  stability 
regions. 

A  large  number  of  methods  were  found  in  this  invest iga- 
tlon,  and  only  a  few  have  been  mentioned  or  used.  Space  has 
not  permitted  a  full  discussion  of  the  procedure  used  to  find 
these  methods.  For  a  further  discussion  of  these  procedures 
refer  to  Nolting  [9]. 


APPENDIX 


TABLE  A-l 


Fir  at  Coaponant  Solution  of  Probla  PI 


Stap 

(h»0.005) 

Trua 

Solution 

Fourth  Ordar 
Calculatad  Valua 

Naar-Ootlaal 

Global  Error 

Fourth  Ordar 
Calculatad  Valua 

BDF 

Global  Error 

0 

0.20000+01 

0.2000Q+01 

0.0 

0. 2000Q+01 

0.0 

200 

0.3679Q+00 

0.3679Q+00 

-0.5267Q-06 

0,94750+01 

-0.91070+01 

400 

0.13530+00 

0.13530+00 

0.3970Q-10 

0.21220+03 

-0. 21210+03 

600 

0.4979Q-01 

0.497 9Q-01 

0.1872Q-10 

-0.81810+03 

0. 81810+03 

S00 

0. 1832Q-01 

0.18320-01 

0. 9199Q-11 

-0. 12850+06 

0.12850+06 

1000 

0. 6738Q-02 

0.6738Q-02 

0.42340-11 

-0. 20080+07 

0.2008Q+07 

TABLE  A-2 

Sacond  Coaponant  Solution  of  Froblaa  PI 


Stap  Trua 

(b*0. 005)  Solution 


_ Fourth  Ordar  Haar-Optlaal 

Caleufatad  Valua  Global  Error 


0 

0.0 

0.0 

200 

0.27940-43 

-0.191 6Q-03 

400 

0.0 

0.4772Q-11 

600 

0.0 

-0.1773Q-17 

800 

0.0 

-0.5826Q-22 

1000 

0.0 

0.3869Q-27 

0.0  0.0  0.0 

0.19160*05  0,59680+01  -0.59680+01 

-0.4772Q-U  -0.1348Q+03  0.13480+03 

0. 17730-17  -0.5742Q+04  0.57420+04 

0.3826Q-22  -0.37380+05  0.3738Q+O5 

-  0.3B69Q-27  0. 23480+07  -  0.2348Q+07 


TABLE  A- 5 


First  Component  Solution  of  Problas  P2  by  Fifth  Order  Methods 


Step  True  _ Fifth  Order  Naar-Optimal _  Fifth  Order  BOF 


(h-0.005) 

Solution 

Celeuleted  Velue 

Clobel  Error 

Celeuleted  Velue 

Clobel  Error 

0 

0. 2000Q+01 

0.2000Q+01 

0.0 

0.20000+01 

0.0 

200 

0.3679Q+00 

0.3679Q+00 

•0.2413Q-U 

0.9366Q+03 

-0.93660+03 

A  00 

0.1353Q+00 

0.  13530+00 

-0.1687Q-12 

0.1696Q+08 

-0.1696Q+08 

600 

0.4979Q-01 

0.4979Q-01 

-0. 9338Q-13 

0.2666Q+12 

-0.26660+12 

800 

0. 1832Q-01 

0.1832Q-01 

-0.4588Q-13 

0.28 S2Q+16 

-0.28520+16 

1000 

0. 6738Q-02 

0. 6738Q-02 

-0.2112Q-13 

•0.20260+20 

0.20260+20 

TABLE  A- 6 

Second  Coaponent  Solution  of  Problea  P2  by  Fifth  Order  Methods 

Step 

(h-0.005) 

True 

Solution 

Fifth  Order  Neer-Ootlael 

Fifth  Order  BDF 

Calculated  Velue 

Clobel  Error 

Calculated  Value 

Global  Error 

0 

0.0 

0.0 

0.0 

0.0 

0.0 

200 

-0.3610Q-43 

-0.5067Q-12 

0. 5067Q-12 

0.2S58Q+04 

-0.2558Q+O4 

400 

0.0 

-0.4956Q-23 

0.49460-23 

0. 6429Q+08 

-0.6429Q+08 

600 

0.0 

-0. 1757Q-31 

0. 1757Q-31 

0.1601Q+13 

-0.1601Q+13 

800 

0.0 

-0.63350-32 

0.63350-32 

0.39530+17 

-0.3953Q+17 

1000 

0.0 

-0.13330-32 

0.1333Q-32 

0. 9673Q+21 

-0. 9673Q+21 

TABU  A-7 

Third  Component  Solution  of  Problea  F2  by  Fifth  Order  Methods 


Step 

(h-0.005) 

True 

Solution 

Fifth  Order  Hear-Ontlaal 

Fifth  Order  BDF 

Calculated  Value 

Global  Error 

Calculated  Value 

Global  Error 

0 

-0. 99000+00 

-0. 9900Q+00 

0.0 

-0.9900Q+00 

0.0 

200 

0.81390-43 

-0.8977Q-12 

0. 89770-12 

-0.73210+04 

0.73210+04 

400 

0.0 

0.7781Q-22 

-0. 7781Q-22 

-0.17750+09 

0.17750+09 

600 

0.0 

-0.46090-32 

0.4609Q-32 

-0.4267Q+13 

0. 4267Q+13 

800 

0.0 

0.22430-*2 

-0. 2243Q-42 

-0.10160+18 

0.1016Q+18 

1000 

0.0 

-0.96320-53 

0.96320-53 

-0. 2398Q+22 

0.2398Q+22 

TABLE  A-S 

Fourth  Coaponent  Solution  of  Froblsn  P2  by  Fifth  Order  Methods 


Step 

(h-0.005) 

9  True 

Solution 

A 

Fifth  Order 

Heer-Opt laal 

Fifth  Order  BDF 

Calculated  Value 

Global  Value 

Calculated  Value 

Global  Error 

0 

0.2500Q+01 

0.25000+01 

0.0 

0.25000+01 

0.0 

200 

0.5816Q-4} 

0. 59670-11 

-0.5967Q-11 

-0. 1914Q+03 

0.1914Q+03 

400 

0.0 

-0.1604q-21 

0.1604Q-21 

-0.21240+08 

0.2124Q+08 

600 

0.0 

0.4982Q-32 

-0.4982Q-32 

-0.9187Q+12 

0. 9187Q+12 

800 

0.0 

-0. 1293Q-42 

0. 1293Q-42 

-0.32000+17 

0.3200Q+17 

1000 

0.0 

0.2167Q-53 

-0.2167Q-53 

-0. 1006Q+22 

0.1008Q+22 
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TABLE  A- 9 


Fir*t  Coaponent  Solution  of  Problea  P2  by  Sixth  Order  Method* 


Step  True  Sixth  Order  Neer-Ootiael  Sixth  Order  BDF 

(hpO.OOS)  Solution  Celculeted  Velue  Globel  Error  Celculeted  Velue  Globel  Error 


0 

0.2000Q+01 

0.20000*01 

0.0 

0.20000*01 

0.0 

200 

0.3679Q*00 

0.36790*00 

-0.3246Q.09 

-0.16670*14 

0.16670*14 

400 

0. 13330*00 

0.13S3Q*00 

U.J810Q-14 

0.39790*29 

-0.3979Q+29 

600 

0.4979Q-01 

0.4979Q-01 

0. 2113Q-14 

-0.80160*44 

0.8016Q+44 

300 

0.1832Q-01 

0.1832Q-01 

0.10390-14 

0.14670*60 

-0.14670*60 

1000 

0. 6738Q-02 

0. 6738Q-02 

0.47860-13 

-0.25080*75 

0.25080*75 

TABLE  A- 10 

Second  Coaponent  Solution  of  Problea  P2  by  Sixth  Order  Method* 


Stop  True  Sixth  Order  Naar-Ont leal  Sixth  Order  BDF _ 

(h-o.OOS)  Solution  Calculated  Value  Globel  Error  Celculeted  Velue  Globel  Error 


6 

0.0 

0.0 

0.0 

0.0 

0.0 

200 

-0. 3  610Q-43 

0. 6007Q-10 

-0, 6007Q-10 

-0.43190*14 

0.43190*14 

400 

0.0 

-0.2089Q-18 

0. 2089Q-18 

0.59430*29 

-0.59430*29 

600 

0.0 

-0.6930Q-28 

0. 69500-28 

-0.76110*44 

0. 7611Q+64 

800 

0.0 

-0.2182Q-31 

0.2182Q-31 

0.87 33Q+59 

-0.8753Q+59 

1000 

0.0 

-0.5375Q-32 

0.337SQ-32 

-0.82160*74 

0.82160*74 

TABLE  A- 11 

Third  Coaponent  Solution  of  Problea  P2  by  Sixth  Order  Method* 


Step  True  _ Sixth  Order  Near-Optiael  Sixth  Order  BDF 

(h-0.005)  Solution  Celculeted  Velue  Global  Error  Calculated  Value  Global  Error 


0 

200 

'400 

600 

800 

1000 

-0. 99000*00 
0.8139Q-43 

0.0 

0.0 

0.0 

0.0 

-0.9900Q+00  0.0 

-0.47150-09  0.47150-09 

0.45030-18  -0.4503Q-1B 

0.3034Q-27  -0.3034Q-27 

-0.14080-36  0.1408Q-36 

-0.16510-45  0.1651Q-43 

-0.9900Q+00 

0.1245Q+15 

-0.1880Q+30 

0.26960*45 

-0.3640Q+60 

0.4537Q+75 

0.0 

-0.12450+15 

0.1880Q+30 

-0.2696Q+45 

0.36400*60 

-0.4537Q+75 

TABLE  A- 12 

Fourth  Coaponent  Solution  of  Problea  P2  by  Sixth  Order 

Methods 

Step 

True 

Sixth  Order  Near-Oot Inal 

Sixth  Order  BDF 

(h-0. 005) 

Solution 

Calculated  Value  Global  Error 

Calculated  Value 

Global  Error 

0 

0. 2500Q+01 

0.25000+01 

0.0 

0.25000*01 

0.0 

200 

0.5316Q-43 

0.75190-09 

-0.75190-09 

0.10890+13 

-0. 1089Q+13 

400 

0.0 

0.38850-18 

-0. 3885Q-18 

0.40610*29 

-0.4 061Q+29 

600 

0.0 

-0.25900-27 

0.25900-27 

-0.1250Q+45 

0.12500+45 

800 

0.0 

-0.22750-36 

0.2275Q-36 

0.2800Q+60 

-0.2800Q+60 

1000 

0.0 

0.7022Q-46 

-0.7022Q-46 

-0. 5457Q+75 

0.5457Q+75 
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TABLE  A-1S 


lUt  tonal 

Coaff icianta  of  cha  Near  Optlaal  Mat hod a  Used 

In  the  Solution  of 

Probltna  PI  and  P2 

Coefficient 

Numerator 

Fourth  Ordar 

Fifth  Ordar 

Sixth  Order 

aQ 

464  400 

27  720  000 

49  824  000 

“l 

-306  600 

-33  100  000 

-72  000  000 

°2 

87  288 

22  300  000 

S3  280  000 

*3 

-3  088 

-  7  200  000 

-18  720  000 

“A 

1  080  000 

1  440  000 

°5 

576  000 

8-l 

109  312 

4  139  873 

6  363  520 

80 

24  163 

-4  117  125 

-9  114  120 

B1 

-64  993 

-1  212  750 

1  413  800 

82 

19  199 

4  067  230 

4  667  600 

®3 

4  829 

-1  537  125 

-1  129  200 

84 

259  875 

-1  858  120 

fl3 

894  320 

Coefficient 

Denominator 

240  000 

9  000  000 

14  400  000 
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Henrici  (1962)  discussed  optimal  Stormer  Cowell 
class  of  linear  multistep  methods  for  the  second  order 
differential  equations  y"  =  f(x,y).  Lambert  and  Watson 
(1976)  established  that  such  formulae  are  orbitally 
unstable  and  developed  symmetric  Lrom  which  annihilates 
the  instability.  Dahlquist  (1978)  proved  a  barrier 
theorem  that  the  order  of  accuracy  of  a  P-stable  Lmm 
cannot  exceed  two.  Hairer  (1979)  generalized  these 
concepts.  Fatunla  (1981)  proposed  symmetric  hybrid 
schemes  well  suited  to  periodic  initial  value  problems. 

A  generalization  of  this  idea  is  proposed  and  a  in¬ 
stable  scheme  of  order  six  is  realized.  The  new 
algorithm  compares  favourably  with  the  existing  schemes 
for  periodic  initial  value  problems  i.e.  Stiefel  and 
Bettis  (1969),  Lambert  and  Watson  (1975) , Hairer  (1979), 
Fatunla  (1981) 


I 


B 

I 

c 

? 


2. 


Introduction : 

Henrici  f4]  and  Lambert  [5]  discussed  the  direct 
application  of  the  Linear  Multistep  scheme 

p(E)y_  «  h2  o(E)f_  (1.1) 

n  n 

to  the  second  order  initial  value  problem 


y"  »  f(x,y),  y(a)  ■  n,  y* (a)  *  <5 


(1.2) 


x  e  R  and  y,  f,  n#  6  are  m-vectors  with  the  assumption 
that  (1.2)  satisfies  the  existence  theorem. 

p (E)  and  o(E)  are  respectively  first  and  second 
characteristic  polynomials  given  as 

k  i 

p(E)  -  I  o.E3  ,  (1.3) 

j«0  3 

0(E)  -  I  6.  E3  ,  (1.4) 

j-0  3 

j 

and  E  is  the  shift  operator  such  that  \ 

\ 

*  yn.j 

where 


*n+j  5 


defined  on  the  discrete  point  set 
t xn I xn  *  a  +  nh,  n  «  0,  1,...  }  . 

The  initial  value  problem  (1.2)  in  general  possesses 
periodic  or  oscillatory  solutions  and  an  important  subclass 
of  the  Lmm  (1.1)  is  the  Stormer-Cowell  formulae  whose 
first  characteristic  polynomial  is  simply 


2 


P  (E)  -  E 


2E  +  1 


(1.6) 


3. 


with  the  optimal  2-step  scheme  given  by  Numerov  Scheme, 
whereby 

cr(E)  -  —  (E2  +  10E  +  D  *  (1.7) 

In  order  to  explain  the  concept  of  P-stability,  we 
consider  the  application  of  (1.1)  to  the  scalar  test 
problem  (1.2)  with 

f(x,y)  ■  -u>2y,  u)  e  R  (1.8) 

leading  to  a  linear  difference  equation 

(p(E)  +  n2o(E))yn  «  0  ,  (1.9) 

(ft  »  uih)  whose  characteristic  polynomial  is 

ir(r,ft)  *  p(r)  +  ft2o(r)  (1.10) 


Definition: 

The  Lam  (1.1)  is  said  to  be  orbitally  stable  if 
there  exists  ft^  such  that  for  an  ft2  c  (0,  ft£) ,  the 
principal  roots  5^  and  ^  on  the  unit  circle  while  the 
spurious  roots  lie  inside  the  unit  circle. 

Dahlquist  [l]  established  that  for  the  Lmm  (1.1)  to  be 
unconditionally  stable,  the  order  of  accuracy  cannot 
exceed  2  and  besides,  among  the  unconditionally  stable 
formulas,  the  scheme  of  Richtmyer  and  Morton  \l ,  pp.  263J 


given  by 


4. 


p(E)  «  E2  -  2E  +  1,  o(E)  »  UE2  +  2E  +  1)  (1.12) 

has  the  minimum  local  error. 


Definition  2  (Lambert  and  Watson  [6j ) . 

The  method  (1.1)  is  said  to  have  an  interval  of 

periodicity  (0,  Q2)  provided  that  for  all  8 2  e  (0,  fl^) , 

the  roots  S  of  ir(r,  Q2)  defined  by  (1. 10)  , satisfy 
s 


ICgl  <  1,  s  -  3(l)k 
where  0  ( £2)  e  R. 

Lambert  and  Watson  developed  symmetric  multistep 
methods  with  non-vanishing  interval  of  periodicity;  a 
desirable  property  deficient  in  the  Stormer  Cowell 
schemes  with  stepnumber  greater  than  two. 

Recently  Fatunla  [2]  proposed  symmetric  hybrid 
methods  of  order  six  which  possess  non-vanishing  intervals 
of  periodicity.  The  resultant  algorithms  denoted  by 

P®  E  Pj  E  Pj  E  CHE  and  specified  as  follows: 

2 

P"  !  yn+H  ’  +  '»n+l  *  15<fn  +  W 


p3  ••  yn+2  *  **„  +  k.l  +  1?<£„  +  5£n.l> 
2  2 


(1.14) 


5. 


.  ,[o] 


E  :  £ 


f  (  X  y  \ 

1 'xn+2  yn+2; 


CH  •  VM 
C2  *  yn+2 


2yn+l  *  yn  +  55<£n+2  +  16£, 


+  26£„.l  +  Wfn+4  +  £n» 


E  s 

n+2 


f(xn+2'  yn+2) 


are  not  P-stable. 


In  this  paper,  we  extend  the  concept  of  Fatunla 
[2]  to  derive  P-stable  hybrid  methods  also  of  order  six. 
With  a  choice  of  a  parameter  r,  0  <  r  <  1,  the  development 
of  the  new  algorithms  are  based  on  the  following  formulae: 


Method  I 


P1  !  yn«  +  a10yn  +  “llVl  *  h’(810£n  +  Bll£n+1> 


E  !  £n+r  -  £(=W  yn+r> 


p2  !  yn+2-r  +  °20yn  *  °21yn+l  *  h!(820£n  *  821£n+l* 


E  !  £n+2-r  '  f(xn+2-r'  yn+2-r> 


(1.15) 


p2  !  yn«  +  a30yn  +  °31yn+l  *  +  B, 


30  n  3rn+l 


E  •  f  t"o]  *  f  ( x  .v  t"o]  j 
E  .  £n+2  £  xn+2  yn+2 


C"  !  yn+2  +  °40yn  +  a41yn+l  *  h2(04Ofn  +  641fn+l 


+  B,,fl?l  + 


S42fn+2  *  Y41fn+r  +  Y42fn+2-r) 


e  •  f  ^  J  ■  f  ( x  w  \ 

E  •  n+2  1  xn+2  yn+2  ' 


6. 


T-1 

0 

n 


« 

h 


► 


Other  alternatives  are  methods  II,  method  III  and 
method  IV  whereby  the  predictor  P2  are  respectively 
replaced  by  the  following  predictors: 

^2  :  yn+2  +  0t3Oyn  +  a31yn+l  “  h2(831fn+r  + 


y32fn+2-r) 


*2  s  yn+2  +  a30yn  +  a31yn+l  =  h2(e^nf«  +  f«*i  + 


'30  n  31  n+1 


Y31fn+r), 


P2  !  yl?2  +  a30*n  +  a31yn+l  =  h2(830fn  +  831fn+l  + 


Y32fn+2-r}  • 


In  section  2,  we  shall  discuss  the  development  of  the 
P-stable  formulae  while  section  3  deals  with  the  effective 
solution  of  the  iteration  scheme.  The P  -stability  of  the 
symmetric  scheme  is  discussed  in  section  4  while  section  5 
is  concerned  with  the  numerical  experiment  and  comparison 
with  the  existing  schemes. 


2.  Development  of  Integration  Formulae: 

In  this  section  the  coefficients  of  the  integration 
formulae  (1.15)  are  obtained  in  terms  of  parameter  r, 

0  <  r  <  1.  This  is  illustrated  with  the  integration  formula 
for  the  first  hybrid  step  i.e. 

yn+r  +  a10yn  +  allyn+l  *  h2(610fn  +  8llfn  +  1> 

.  (2.1) 


9 


while  the  other  formulae  are  simply  stated. 


We  now  associate  with  (2.1)  the  linear  difference 
operator  (^[yfx),  hj  defined  as  follows: 

lll>(V'  h]  ■  *<xn«>  +  “lO*(xn’  +  ‘ll^Vl1 

-h2  (61Qy '  (xn)  +  Bny'(xn+1)).  (2.2) 

If  we  now  ensure  that  y(x)  is  the  theoretical  solution 
to  (1.1)  and  obtain  the  Taylor  series  of  terms  on  the  rhs 
of  (2.2)  to  obtain 


It 

o 

rH 

u 

1  +  “10 

+  “n 

C11  * 

r  +  au 

C12  * 

h(r2  +  a n)  - 

l610  +  6ll’ 

C13  * 

5(r’  +  “ll >  * 

611 

C14  - 

—  (r1*  + 
24 

•n1  ■ 

•  B11  • 

general  we  have 

Ci5  - 

J7(rj  + 

“u’  ■ 

•  6ir  3  -  3 

With  the  desire  to  obtain  the  highest  possible  order  for 
the  integration  formula  (2.1) ,  the  first  four  equations  in 
(2.3)  are  allowed  to  vanish  and  the  resultant  system  of 
linear  equations  has  the  following  solution: 


8. 


_  -r(r  -  1) (r  -  1) 


(2.4) 


611  *  r(r  _  1) <r  +  1) 

thus  yielding  the  integration  formula: 


yn+r  ’  ^n+l  +  <r"1)y«  *  z-L-r(r-l)  (r-2)f. 


n  6 


+  r(r-l) (r+l)f  ]  (2.5) 


with  the  error  constant  obtained  from  last  equation  in 
(2.3)  as 


c  =  £i£zil(r2_r„i) 

u14  24  r  * 


(2.6) 


Using  identical  argumetns,  the  integration  formula 
for  the  second  hybrid  step  can  be  obtained  as: 

yn+2-r  +  {r-2)yn+l  "  (r“1)yn 


=  £-[-(r-l)  (r-2)  (r-3)f  .  +  r  (r-1)  (r-2)  f] 


(2.7) 


with  error  constant 


C24  ’  yf[(r-2)  (-(2-r)  3  +  1)  +  2  (r-1)  (r-2)  (r-3)J  •  (2.8) 
Similarly,  the  predictor  for  method  I  is  obtained  as 


-  2V.l  +  •  h‘£r 


(2.9) 


and  error  constant 


'34  12 


Finally  the  hybrid  corrector  is  obtained  as 


*n+2 


*n+l  T  *n 


L12  20r  (r-2)  J  n+2  ^n' 


n 


4 


4 


+  £i  “  10(r-l)^fn+l  "  20r  (r-1) 2  (r-2)  (fn+r+  fn+2-r} } 

(2.10) 

with  error  constant  C4g  ' 

-  _  1  r .  nf37  64  (r-1)  2  -  2r (r-2)  -  (r‘+(2-r)  S)1 ,  . 

C4S  -  8l{254  8L^  5S7(T-U!Tr~)  jK 

(2.11) 

While  the  two  hybrid  formulae  (2.5)  and  (2.7)  as  well  as 
the  predictor  formula  (2.9)  are  of  order  2,  the  hybrid  corrector 
formula  (2.11)  is  of  order  six.  The  corrector  formula  (2.11) 
being  implicit  has  to  be  solved  iteratively  and  this  is 
discussed  in  the  next  section. 


3.  Solution  Process  for  Corrector  Formula  (2.11) 

With  a  starting  value  yjj^  9iven  fay  formula  (2.9),  the 
corrector  formula  (2.11)  is  solved  iteratively  as 


2W  +  *n  +  h*K«*«+l+C<WWr>J 

+  h2A£<!tn+2'>’I+2>'  (3-1) 


for  s  *  0,  1,  2 , . . . 
where 


A  » 


(3.2) 


1_ 

12 


+ 


1 

20r (r-2)  ' 


(3.2) 


B  »  6 


41 


5  1 

6  ’  10(r-l) 2 


r 


(3.3) 


10. 


and 


C  “  y41  "  Y42 


20r (r-1) 2 (r-2) 


(3.4) 


The  convergence  of  (3.1)  is  assured  provided 


»*ii»£ii.  < 1 , 

|| .  ||  is  the  maximum  norm. 


(3.5) 


Unfortunately,  for  highly  oscillatory  systems  of  the  fora 
(1.2),  we  have  that 


lljll-  »  i 


(3.6) 


and  thus  impose  a  severe  constraint  on  mesh-size  h.  This 
constraint  could  be  averted  with  the  introduction  of  the 
Newton  Raphson  procedure  into  (3.1)  i.e.  wish  to  solve  the 
nonlinear  equation 


F<W  ■  *n+2  -  h’A£(IWW  ' 


n+1 


+  y 


n 


-h2LAfn  +  Bfn+1  +  C(fn+r  +  fn+2-r>J 


0. 


(3.7) 


The  application  of  Newton  Raphson  Scheme  to  (3.7)  yields 

-  l1  -  h’A  fy.1!1,). 


3y  n+2  jrn+2  J 


n+2' 


(3.8) 


s  *  0,  1,  2 , . . . 

and  this  invariably  cpnverges  in  one  or  two  iterations: 

We  confine  our  numerical  experiments  in  section  5  to  only 


11. 


one  iteration. 

4.  P-Stability  Consideration  and  Determination  ot  Parameter  r 

The  application  of  the  integration  formulae  (2.5), 

(2.7)  and  (2.11)  to  the  scalar  test  problem 

y«  =  u»ly,  w  >  0  (4.1) 

respectively  leads  to  the  following  difference  equations: 

*„«  -  -  <r-1)l’n  -  ^-C-r(r-l)  (r-2)yn 

+  r(r-l)  (r+l)yn+11 

(4.2) 

yn.2-r  ■  -(r-2)'Vl  +  -  f[-(r-l)(r-2)(r-3)yn+1 

+  r(r-l)  (r-2)yj,  (4.3) 

and 

Ei  +  n2A>„+2  -  C2  +  ®n!]y„+i  *  0-  *  o*\lya 

*  &n+r  +  yn+2.r]  <«•«> 

where  A,  B  and  C  are  specified  by  equations  (3.2),  (3.3) 
and  (3.4). 

The  adoption  of  (4.2)  and  (4.3)  in  (4.4)  gives  the 
following  second  order  difference  equation: 

R(n)yn+2  +  S(fl)yn+1  +  R(n);  (4*5) 

where 

RIB)  -  &  +  «*<il  *  20rTr-2)1l' 


(4.6) 


L6  10 (r-1) 2  10(r-l) 2 (r-2) 


1 

LOr (r-3 


“loi  +  1  f  r+l _ r-3  ",  0*t 

rjw  +  eOMr-l)  (r-2)  r(r-l)iw 


(4.7 

The  characteristic  equation  associated  with  (4.5)  Is 


given  as 


R(G)r2  +  S(fi)r  +  R(fl)  *  0 


which  the  bilinear  transformation 


1+2 


(4.8 


reduces  to 


£2R(n)  -  S(fl)]z2  +  0>R(n)  +  S(fl)]  -  0  • 

The  roots  of  (4.9)  are  purely  imaginary  and  lie  on  the 
unit  circle  provided 


2R(fl)  +  S(fl) 


(4.1 


i.e. 


S(fl)  -  0 


(4.1 


This  implies 


-2  ♦  C- 


10 (r-1) 2  10(r-l) 2 (r-2)  lOr(r-l) 


r-1) 


60l-(r-l)  (r-2)  r(r-l)i 


r-2 


(4.i; 


At  Q  *  •  ,  equation  (4.12)  reduces  to 


r+1  r-2 

(r-1) (r-2)  “  r(r-l) 


«  0 


(4.13) 


~1 

, 

a 

% 

s 

M 

# 

r  * 


which  gives 


r  -  |  (4.14) 

Hence,  the  adoption  of  (4.14)  in  the  integration 

/ 

formula  (3.8)  leads  to  a  P-stable  scheme. 


5 .  Numerical  Experiments 

We  first  consider  the  nearly  periodic  initial  value 
problem  of  Stiefel  and  Bettis  [8j 

2"  +  z  -  0.001eix,  2  e  C  (5.1) 

2(0)  -1,  2' (0)  -  0.99951 
whose  theoretical  solution  is  given  as 
Z (x)  »  u(x)  +  iv(x) , 

U(x)  *  cos  x  +  0.0005x  sin  x,  (5.2) 

V(x)  *  sin  x  -  0.0005x  cos  x. 

(5.2)  denotes  a  motion  on  a  perturbed  circular  orbit  which 
spirals  outwards  at  a  distance 

y(x)  ■  /ul (x)  +  vl (x)  (5.3) 

from  the  origin. 

Problem  (5.1)  was  solved  numerically  in  the  interval 
0  N<  x  <  40*  adopting  unoform  mesh-sizes 

,  f  7T _  IT  7T  IT  IT 

h  i12'?'?-'5,4> 

in  the  PE  E  PE_r  E  P2  E  ^  E  mo^e  r  ■  j  considering 

the  cases: 


14 


r 

• 

si 

4 

si 

si 

* 

=r 

\ 

\ 

\ 

s 

S 

^ . 

M 

VO 

ov 

cn 

«k 

to 

K 

H* 

(-> 

O 

O 

O 

cn 

•• 

• 

o 

• 

O 

• 

VO 

• 

VO 

• 

vo 

rf 

0 

o 

O 

VO 

VO 

OV 

n 

M 

vo 

KjJ 

cn 

3 

VO 

03 

cn 

'J 

Ov 

r—iA 

u» 

to 

vo 

U> 

.U 

oo  ti 

u> 

VO 

ov 

•u 

cn 

*  4  | 

*.  * 

O 

0 

c 

0 

(0 

b* 

— 

- 

I-* 

»-* 

F 

• 

• 

O 

• 

O 

• 

O 

• 

O 

• 

O 

0) 

a 

O 

h- 

O 

H* 

O 

to 

o 

to 

O 

Ui 

Er 

A 

-  * 

vo 

VO 

O 

to 

O 

-O 

t- 

Ov 

ui 

00 

-o 

*J 

-*'■ 

a» 

cn 

,  •. 

a r 

01 

. 

c 

.  „ 

X 

-  i 

t— • 

H* 

t— 1 

M 

M 

N 

• 

• 

• 

• 

• 

01 

4k> 

O 

o 

o 

O 

O 

• — itt 

o 

H 

O 

o 

o 

O 

O 

to  c 

si 

t— 

to 

to 

to 

Ui 

'—*3 

> 

VO 

O 

h-* 

O 

H* 

f 

vO 

to 

03 

to 

to 

Ol 

-< 

V 

H* 

O 

o 

M 

1— 

• 

tr» 

M 

*  .,1 

t— 

H* 

!-• 

u 

II 

• 

• 

• 

• 

• 

1 

O 

O 

Q 

O 

Q 

Ui  ® 

b-> 

O 

O 

O 

O 

O 

.  rt 

• 

r 

H* 

K-» 

to 

to 

to 

00  Ot 

o 

t— * 

■’ 

VO 

VO 

Q 

O 

M 

w  cr 

o 

-o 

Q 

w 

Ui 

t-1 

t— * 

(B 

UI 

-o 

5 

ui 

to 

A 

VO 

~4 

— 

to 

to 

O 

S’ 

v'. 

A 

•  * 

a 

A 

• 

' 

i 

i 

I 

• 

-  1 

, 

. 

■m 

—  -4 

" 

•9 

■ 

I 


i 

* 

00 

— 

c 

• 

— 

0) 

6 

0) 

jC 

o 

s 

w 

O  H  00  «  (N 

~ 

0) 

vo  vo  in 

1 

H 

H 

i 

t  . 

X! 

!, 

<0 

f 

P 

r 

(0 

1 

L 

1 

u 

0. 

1 

1— • 

- 

i* 

IN 

i’ 

1— * 

1 

IQ 

, 

r-4 

o>  ov  oo  oo  <n 

1 

«1 

c 

—  n*  ro  o  n>  -h 

3 

DO  n  N 

P 

3  *H 

.  .  ON 

« 

h 

fa 

e* 

?- 

W 

1 

*  »J 

VO 

.  “ 

*— 1 

x 

M  CO 

0*1 

0 

>“ 

o\ 

in 

*H 

p 

X 

i  ‘  • 

O 

10 

•t  s 

O 

X 

<0 

.  ' 

• 

O 

- 

H 

«B 

*-o  vn  «n  vn  vo  h 

OV  X- 

8 

it 

P 

P 

<D 

A 

O  ON 
rH 

rMV> 

X 

r  . 

g 

»s .  • 

10 

y 

% 

►4 

r—> 

r  * 

00 

*•— 

1 — 1 

H 

*> . 

0) 

5 

0 

« 

p 

o 

o 

1 

►  i 

W) 

<u 

Is  oo  VO  Cl  Ol 

II 

e 

ON  on  r*  Tf  H 

u 

Cl  N  Cl  H  1 

X 

o 

VO  00  ON  1 

p 

CO  1  1 

(0 

t 

- 

-* 

IN 

n>  vn  vo  ov  i-o 

- 

£ 

\  \  \  N  N 

P  P  P  P  P 

, 

a 


ST 


16. 


C 
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(a)  without  incorporating  Newton  Raphson  i.e. 
in  formula  (2.10) 

(b)  incorporating  the  Newton  Raphson  scheme 
i.e.  formula  (3.8) 

Tables  1  and  2  give  a  detailed  comparison  of  the  proposed 
scheme 

(i)  five  step  Stormer  Cowell  scheme  of  order  six  [8j 

(ii)  Symmetric  multistep  methods  of  order  6  [6j 

While  the  proposed  scheme  whose  corrector  is  also  of  order  six 
compare  favourably  with  the  syrutuetric  multistep  scheme  of 
Lambert  and  Watson  [6] ,  they  are  both  superior  to  the  Stormer 
Cowell  Methods  [8] . 


We  finally  consider  the  example  proposed  by  Lambert 
and  Watson  “[6]  and  designed  to  illustrate  P-stability: 

y”  +  <*>2y1  ■  f"  (x)  +  w2f(x); 

yx (0)  »  a  +  f(0),  y^(0)  -  f’(0)  (5.4) 

y2  +  (o2y2  ■  f”  (x)  +  w2f(x); 
y2(0)  =  f(0),  y2 (0)  -  wa  +  f'(0)  . 

The  theoretical  solution  to  (5.4)  is  given  as 


y^(x)  *  a  cos  u>  x  +  f(x) 
y2(x)  ■  a  sin w x  +  f(x) 


with 


f  (x) 


-0.05x 

B 


(5.5) 


(5.6) 


17. 


and  thraa  different  values  of  parameter  a  are  adopted  i.e. 
a  -  {0,  0.1,  0.2} ‘ 

The  numerical  integration  scheme  was  applied  to 
ivp  (5.4)  in  the  interval  0  <  x  <  20*  using  a  uniform  mesh 
size  h  ■  -j2  * 

The  same  problem  was  solved  by  Lambert  and  Watson  in 
| 6 |  using 

(i)  Numerov  Method  (1.6  -  1.7) 

(ii)  Symmetric  Multistep  Scheme  p  »  2,  C  -  -fj 

(iii)  Symmetric  Multistep  scheme  p  ■  2,  C  ■  -k 

While  the  Numerov  Scheme  is  not  P-stable,  both  the  proposed 
scheme  as  well  as  symmetric  scheme  of  Lambert  and  Watson  [6j 
are  P-stable.  Table  3  gives  the  error  E  in  the  radius 

r  -  /yj  +  y$ 


at  x  *  20*. 


Numerov  Method  [8]  Lambert  4  Watson  |_6]  P-Stable  Methods 
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Some  Comments  on  Stability  and  Error  Analysis 
for  Stiff  Nonlinear  Problems 

Germund  Dahlquist 
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and  Stanford  University 

ABSTRACT 

First  some  basic  facts  and  notions  concerning  stiff 
nonlinear  ODE's  will  be  presented,  partly  by  examples. 
Techniques  for  deriving  stability  properties  and  error  bounds 
for  certain  classes  of  nonlinear  systems  will  be  described. 
Some  of  the  techniques  are  applicable  to  variable  step  size. 

If  stability  can  be  proved  for  a  system  with  a  Jacobian 
J(t),  when  the  step  size  is  h(t),  then  a  modified  stability 
result  is  valid  for  the  system  with  Jacobian  J(t)  +  AJ(t),  if 
(in  the  case  of  one-leg  multistep  methods), 

J[|  (M  +  AM)  •  AJ*M||  dt 

is  reasonably  bounded,  where  M  *  (I  -  hJ^/a^)-^ 

Results  are  known  for  monotonic  systems,  i.e.,  when  the 
Jacobian  has  a  negative  loqarithmic  norm,  relative  to  some 
inner-product  norm,  and  for  systems  with  a  negative  diagonal- 
dominant  Jacobian,  see  e.g.,  Kreiss.  The  generalized 
contractivity  analysis  for  one-leg  multistep  methods  will  be 
summarized,  see  also  Dahlquist  1978,  Sflderlind  and  Dahlquist 
1981.  In  the  latter  paper  improved  results  are  given  for 
systems  of  singular  perturbation  type,  also  covering  the  case 
when  different  methods  are  used  for  different  subsystems. 
Improved  results  for  monotonic  systems,  when  the  time- 
derivative  of  the  Jacobian  is  bounded,  are  given  by  Sftderlind 


1981 


Contractivity  analysis  for  linear  multistep  methods 


and  one-leg  methods,  in  maximum  norm,  is  discussed  by 

Nevanlinna  and  Liniger  (1978)  and  Sand  (1981),  also  for  the 
case  of  variable  step  size.  Hundsdorfer  (1981)  has  extended 

the  analysis  of  contractivity  (B-stability )  for  Runge-Kutta 
methods,  given  by  Butcher  (1975)  and  Burrage  and  Butcher 
(1979),  to  a  Rosenbrock  method.  Dahlquist  and  Jeltsch 
studied  generalized  contractivity  properties  of  Runge-Kutta 
methods,  which  need  not  be  A-stable.* 

Much  remains  to  be  done,  in  particular  concerning  the 
following  things: 

i)  instabilities,  which  may  be  caused  by  the  change  of 
step  size  and  order, 

ii)  the  practical  verification  during  the  computation 
that  the  assumptions  of  the  theory  are  satisfied  at  the  point 
and  with  the  step  size  proposed, 

iii)  the  automatic  detection,  if  one  of  the  eigenvalues 
of  hJ(t)  with  large  modulus  approaches  the  imaginary  axis  (in 
particular  the  origin). 

A  sketch  of  an  asymptotics  for  variable  step  size  has 
recently  been  worked  out  by  Dahlquist  (1981,  rep.  8110). 


♦Nevanlinna  and  Odeh  (1981)  have  recently  developed  a  very 
powerful  technique  for  nonlinear  stability  analysis  for  fixed 
step  size. 
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Abstract:  Some  of  the  work  on  contractivity  of  muitistep  and  one-leg  methods  for 
ordinary  differential  equations  is  surveyed.  This  theory  provides  sufficient  conditions 
for  stability  of  such  methods  as  applied  with  variable  steps  to  certain  classes  of 
nonlinear  systems  and  equations  with  variable  coefficients.  It  also  identifies  explicitly 
families  of  A0-  and  A-stable  formulas  which  can  be  extended  to  variable  steps  in  such 
a  way  that  these  stability  properties  are  preserved  for  some  of  the  problem  classes 
mentioned  above. 
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1.  Introduction 


A  linear  multistep  formula, 

2  ay*»-y-*  2  bfn-j  -  °. 

7-0  jm 0 


(M) 


normalized  by 

k 

2  bj  -  1.  (1.2) 

y-o 

is  said  to  be  stable  at  q  -  AX,  if  all  solutions  {*„}  of  the  difference  equation 

k 

2  (arqbj)xm_j  .0  (1.3) 

y-o 

generated  by  applying  (1.1)  to  the  "test  equation" 


x  m  \x,\  const.,  complex,  (1.4) 

I  i 

on  the  uniform  grid  {?„!*„  -  nA,  n  —  0,  1, ...}  are  bounded  for  a  given  A  >  0  as 
n-wB.  The  set  of  all  q's  at  which  (1.1)  is  stable  is  called  the  stability  region  S  of  the 
formula.  On  the  uniform  grid  and  for  constant  formula  coefficients,  we  have  stability 
at  q  iff  the  "root  condition"  is  satisfied. 

In  practical  applications,  multistep  formulas  are  used  to  solve  non-linear  systems  of 
differential  equations,  or  linear  equations  with  variable  coefficients.  Furthermore,  they 
are  normally  implemented  with  variable  steps,  and  under  any  or  all  of  these  circum¬ 
stances  it  is  in  general  hard  to  find  necessary  and  sufficient  conditions  for  asymptotic 
stability  of  the  difference  equation.  The  theory  of  contractivity,  part  of  which  is 
summarized  in  this  paper,  gives  sufficient  conditions  for  stability  in  some  of  these 
cases,  notably  a)  for  dissipative  (monotone  negative)  nonlinear  systems  of  differential 


equations 


rt 


i  -  /(f,  *). 


'  (15) 


i.e.,  systems  satisfying  [4,5] 


<x  -  y .  fO,  x)  -  /(i,  y)>  S  n |x  -  y f 


(1.6) 


for  some  scalar  product  <,>  and  some  a  £  0,  where  |x  |  :=  <x,  x>;  and  b)  for  the 
variable  coefficient  test  equation 


x  *  X(/)x,  X(/)  complex 


(1.7) 


with  arbitrary  X(r)  in  the  negative  left  half-plane  or  in  some  subset  thereof.  Further¬ 
more,  contractivity  results  can  be  gotten  for  variable  (in  some  cases,  arbitrary)  step 
sequences  {*„}  as  well  as  for  constant  steps.  For  variable  steps,  the  formula  usually 
has  variable  coefficients,* 

ft  ft 


j  2  ajjtXn-j~bn  2 
jmO  jm  0 


(1.8) 


normalized  again  by 


2  bj.»  - x- 

jmO 


(1.9) 


In  general,  however,  stability  results  for  variable  steps  are  obtained  only  if  the  formula 
(1.8)  is  implemented  as  a  one-leg  (OL)  method  [4,5] 


^ir xn~bnf^n^ir  m 


(110) 


*  In  some  cases,  it  is  advantageous  to  write  the  variable-step  formulas  in  terms  of  a 
step  other  than  the  leading  step  h„,  as  discussed  in  Section  3  hereafter. 


-  2  - 


where 


C 

D 


*  * 

>-o  y-o 

rather  than  in  the  usual  multistep  (MS)  form 

(1.12) 

In  studying  contractivity  of  the  discrete  solutions  {x*}  of  the  test  equation  (1.4)  or 

(1.7)  (respectively,  the  non-linear  system  (1.5))  we  ask  whether  {*„}  (respectively  the 

difference  {x„}  of  any  two  solutions  {y„)  and  O'*  4-  x*})  is  non-increasing  in  an 

appropriate  sense  (rather  than  bounded  as  in  discussing  stability)?  More  precisely,  we 

ask  whether  |-Y*_, 1  2  I  **  I  in  some  given  norm  B*|  (independent  of  n),  where 

XH".“  (xB_k+,,  x*_4+2 . **)?  H  this  is  tbs  case  for  all  n  2  *.  then 

\Xk_x  I  2  1**1  and  we  have  stability.  When  applied  to  the  constant  coefficient  test 

equation  (1.4)  with  fixed  steps,  both  the  MS-  and  the  OL-implementations  of  (1.1) 

lead  to  the  difference  equation  (1.3).  In  this  case,  the  formula  (1.1)  is  said  [15]  to  be 
1  i 

contractive  at  q  m  h\  if  {x*}  is  non-increasing  in  the  above  sense  for  any  solution  of 
(1.3)  computed  with  constant  step  size  A.  The  set  of  all  q  at  which  the  formula  is 
contractive  (for  the  given  norm)  is  called  the  contractivity  region,  K.  Clearly,  contrac¬ 
tivity  at  q  implies  stability  at  q  and  thus  KZS  for  any  norm.  By  analogy  to  the 
corresponding  stability  concepts,  we  say  that  a  formula  is  A-contractive, 
Ao-contractive,  etc.  if,  respectively,  the  left  half  9-plane,  the  negative  real  9-axis,  etc., 
are  contained  in  K.  Every  one  of  these  contractivity  properties  implies  the  corre¬ 
sponding  stability  property. 

When  applied  to  (1.4),  both  implementations  of  the  variable-step  formula  (1.8)  give 

2  -  °.  (M3) 

y- 0 

-  3  - 


where  q„  -  hH\.  Note  that  q„eKn  for  all  a  is  sufficient  for  stability,  i.e.,  q  need  not  be 
constant.  When  implemented  as  a  OL-method  and  applied  to  the  variable-coefficient 
test  equation  (1.7),  the  formula  (1.8)  still  generates  a  difference  equation  of  the  form 
(1.13)  but  with  q„  -  A, A  (5,/,).  and  again  we  have  stability  if  {$„}£*„.  By  contrast, 
the  MS-method  applied  to  (1.7)  produces  a  difference  equation  of  a  more  complicated 

type. 

* 

2  ~  ?/>*/>  -j m 

0 

one  who’s  contractivity  depends  on  (k  +  1)  complex  parameters  B  -  hn\(tH_j), 
rather  than  on  only  one  of  them,  and  this  is  the  case  even  for  constant  steps. 

Most  of  the  existing  work  on  contractivity  falls  into  one  of  two  categories.  In  the 
first,  contractivity  in  inner  product  norms  of  OL-soiutions  of  dissipative  nonlinear 
systems  (G-stability)  was  introduced  in  [4,5]  and  further  investigated  in 
[6,7,9,11,13.14,15.18,19,20,22].  Contractivity  of  Runge-Kutta  methods  for  the  same 
problem  class  (B-stability)  was  studied  in  [3,8,17]. 

The  second  approach,  the  one  which  is  mainly  surveyed  in  this  paper,  is  to  investigate 
contractivity  in  the  max  norm  or  related  norms  for  the  test  equation  (1.4),  respectively 
(1.7).  For  constant  steps,  contractivity  in  this  sense  was  first  studied  in  [1]  for 
cla««icai  Adams  multistep  and  Runge-Kutta  methods  applied  to  (1.7)  with  A(r)  5  0. 
In  [15,20]  many  aspects  of  the  contractivity  theory  were  developed  systematically; 
Section  2  hereafter  mainly  summarizes  that  work. 

For  non-uniform  grids,  contractivity  of  Backward  Differentiation  Methods  in  certain 
"polygonal"  norms  was  analyzed  in  [2,16,21].  Some  results  on  max-norm  contractivi¬ 
ty  of  variable-step  Adams-type  OL-methods  were  given  in  [20].  A-Contractivity  was 
studied  in  [22]  for  the  class  of  all  second-order  (p  -  2)  two-step  (k  -  2)  formulas,  a 


two-parameter  family.  It  was  sbown  that,  for  any  given  ratio  of  the  two  steps,  all 

formulas  of  this  class  which  are  A-contractive,  in  either  the  max  norm  or  in  constant 

•% 

inner  product  norms,  are  members  of  one  and  the  same  one-parameter  sub-family  ' 
all  p  m  k  m  2-formulas.  The  OL-implementations  of  these  formulas  are  A-stable  with 
arbitrary  step  sequences  for  any  dissipative  nonlinear  system  and  for  (1.7)  with  any 
X(r),  Re  X(r)  £  0.  Finally  it  was  shown  in  [25]  that  for  any  k  £  1  and  for  arbitrary 
step  sequences  the  set  of  all  p  -  2,  fc-step  formulas  which  are  A-contractive  in  the 
max  norm  represent  a  (k  -  1) -parameter  sub-family  of  the  (21c  -  2)-parameter  family 
of  all  p  -  2,  Ac-step  formulas.  The  OL-implementation  of  these  formulas  are  A-stable 
with  respect  to  (1.7)  for  any  X(f),  Re  X(r)  £  0,  for  arbitrary  variable  steps.  The 
A-contractivity  work  is  summarized  in  Section  3  of  this  paper. 

2.  General  Discussion  of  Contractivity 

a)  Description  of  the  contractivity  region. 

1  i 

The  contractivity  region  K  has  a  simple  geometry.  With  respect  to  any  norm,  K  is 
closed  and  connected  by  arcs  of  circles  ([15],  Th.  2.1).  For  explicit  formulas,  K  is 
convex.  In  contrast  to  this,  the  stability  region  5  in  general  consists  of  several 
disconnected  components,  as  illustrated  in  [12]  for  a  formula  given  in  [10]. 

With  respect  to  the  max  norm,  we  have  ([15],  Th.  3.1) 

—  k 

K  -  [qet  |F(q):»  £  | aj-qbj |  -  | a0-qh0 1  £  0}.  (2.1) 

The  boundary  of  AT  is  BK  -  {q  |  F(q)  -  0].  It  is  smooth  except  possibly  at  its 
intersection  points  with  the  real  axis.  Many  examples  of  contractivity  curves  are 
plotted  in  [12,20]  in  comparison  with  the  corresponding  root-locus  curves. 
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c)  Existence  of  high-order  contractive  formulas 


For  any  S  >  0  and  any  <l>  <  tr/2  there  exist  ([15],77».4.1)  A(a)-contractive  formulas 
of  Adams  type  (i.e.,  with  a0  -  1,  ax  -  —  1,  a2  •  •••  -  ak  «  0)  and  of  any  order  of 
accuracy  p  such  that  y  defined  by  (2.3)  satisfies*  y  2  1-i  and  a  2  f  It  should  be 
noted,  however,  that  these  formulas  exist  only  for  k  >  kmin(p)  where  k^ip)  is  a 
rather  rapidly  increasing  function  (empirically,  kmin>3p).  Furthermore,  formulas  with 
p  >  2  which  are  A(a)-contractive  (and  thus  A(a)-stable)  with  a  near  e/2  cannot  be 
accurate,  i.e.,  they  must  have  large  error  constants  [23]. 

A  sequence  of  A(«)-contractive  formulas  of  Adams  type  and  of  orders  p  S  6  was 
given  in  [20].  Among  them  is  the  p  -  k  ■  2-formula 

x„— x*,.,,— > j(3i„  +  m  0,  (2.5) 


which  is  characterized  in  Section  3  hereafter  and  which  is  A-stable  and 
A(a)-contractive  with  70.5°,  and  a  formula  with  pm  3  and  km  4, 

+  5K-2-K-4)  -  0,  (2.6) 

which  is  A(a)-stable  with  a  -  78°  and  A(a)-contractive  with  a  -  41°.  In  [20] 
variable-step  extensions  of  (2.5)  and  (2.6)  were  defined  uniquely  by  requiring  that 
they,  too,  have  a2n  -  bljt  -  0,  respectively  a2jl  ■  -  bltH  m  b2jt  ■  0,  and  it  was 

shown  that  the  variable-step  extension  of  (2.5), 


2  +  2r_ 


(2.7) 


*  It  is  trivial  to  verify  that,  subject  to  (1.2),  we  have  y  s  1. 


remains  Ao-contractive  for  arbitrary  step  ratios  rn:-  hH/hH_v 

The  familiar  Backward  Differentiation  Formulas  (BDF)  with  p  -  k  2;  2  are  not 
contractive  in  the  max-norm  at  q  ■  0  [1,15]  (nor  are  they,  therefore,  Aq-,  A(a)-,  or 
A-contractive  in  this  norm).  The  two-step  second-order  BDF, 


(2.8) 


is  A-stable  and  thus  [13]  A-contractive  in  an  inner  product  norm  (G-stable).  Howev¬ 
er,  as  shown  in  [22]  and  discussed  in  Section  3  hereafter,  this  contractivity  does  not 
natprally  extend  to  variable  grids  (see  also  the  remark  at  the  end  of  Sub-section  3a 
hereafter). 


d)  Boundedness  theorem  for  nonlinear  systems. 

In  [20],  Th.  5.1,  a  boundedness  result  was  given  for  the  discrete  solution  of  a  nonli¬ 
near  mxirt-system  of  the  form 

1 

k  -  Mi.  s)s  +  40.  i).  (2.9) 


where  A  -  (a(>)  with  ajl,  x)  <  0.  i,  j  -  1 . m,  and  40,  &)  is  bounded.  A  some¬ 

what  sharper  result  is  the  following  [24]: 

Assume  {*„}  is  a  discrete  solution  of  (2.9);  generated  by  a  one-leg  method  which  is 
both  Aq-  and  A_-contractive  in  the  max-norm,  and  let  B  -  (btj)  with  bu  -  -«„y  >0 

k 

and  bllm-a\bi\)  mp\aiXSi„.  Sx„)\  ^  0.  If  we  let  |  -  (*,).  4  -  (*,). 

'  7-0  J  xj 

*rs  H*,!..  and  8,:=  \d,\m  where  B « I .  denotes  the  max-norm  of  a  scalar  sequence 
{u„},  then  we  have 

S  4,  {  2  0,  4  2  0  (2.10) 
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r  ’ 


0 

B 


9 


and  if  B  is  a  M-matrix  (which  is  the  case  if  A  has  a  sufficient  amount  of  diagonal 
dominance)  then  we  have  input-output  stability. 

If  I.  S  *141.,  (2.11) 


for  some  k  because  B  has  a  bounded  inverse. 

3.  A-contractivity  of  multistap  formulas  with  variabla  stops 

a.  A-contractivity  of  two-step  formulas  with  variable  steps 

In  [22]  contractivity  in  inner  product  norms  (G-stability)  for  dissipative  nonlinear 
systems  and  A-contractivity  in  the  max-norm  were  analyzed  for  the  three-parameter 
family  of  all  methods  with  pm  1  and  km  2  and/or  the  two-parameter  family  of  all 
p  m  k  m  2-methods.  We  summarize  the  results  of  this  theory. 

For  variable-step  G-stalbility  analysis  it  turns  out  to  be  useful  to  write  the  two-step 
formula 


*0*,.  +  -MM*  ♦  Mu-1  +  *2*»-2>  *  0 


(3.1) 


in  terms  of  the  step 


ao*«”a2*«-l* 

where  hn  *  t  and  -  tn-\~tn-i-  With  this  choice  of  the  step,  the  coeffi¬ 

cients  of  the  consistent  (p  -  1)  two-step  formulas  can  be  written  in  terms  of  three 


-  9  - 


f 


parameters  a,  b,c  as 


flo"-r(c  +  l)>  *o  “  "rH  +  *  +  («  +  «).l, 

2  4 

a,--c,  (3.3) 

a,-l(c-l).  62-i[I  +  6-(a  +  c)]. 

2  4 

We  characterize  the  non-uniformity  of  the  steps  by  the  grid-parameter 

e  -  «„:=  (*„-*,-,)/(*„  +  A,.,).  I «  I  <  1.  (3.4) 

>  >  _ 

where  *  5  0  iff  h„  ?  ftn-v  Then  A„  ■  hH(  1  +  r),  »  *,,(1-*),  and 

A  _  .  1 

hn  m  h „(1  +  tc),  where  hH:-  -^(A,,  +  *»- 1)  ts  the  average  step.  For  equal  steps 
a  - 

(e  *•  0),  hH  —  hn  m  hH  -  hn_v  In  general,  t  is  related  to  the  step  ratio 

'  -  V*  hJK-\  vl« 

r  -  (1  +  *)/(l-«)  e  -  (r  -  l)/(r  +  I).  (3.5) 

It  is  easy  to  verify  that  the  formula  whose  coefficients  are  specified  by  (3.3)  is 

i 

second-order  (pm  2)  accurate  iff 

e-€r|^-h].  (3.6) 

t  1  ■+  ec  J 

Thus  for  t  m  0  we  have  p  ■  2  iff  a  m  0. 

Global  contractivity. 


BX.I  £  |A*_,|,n  i  *,  (3.7) 

which  implies  A-stability,  is  assured  for  all  discrete  solutions  of  dissipative  nonlinear 
systems  generated  by  variable-step  one-leg  methods  provided  these  methods  are 
(locally)  G-stable,  i.e.,  Uf,-I  £  II  ( |  for  all  /,  i  -  k,  k  +  1, ....  it,  in  a  G-norm 
|  •  |  which  is  constant  with  respect  to  n,  i.e.,  independent  of  the  step  changes.  It  was 
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shown  [22]  that  the  only  second-order  two-step  formulas  for  which  a  constant  G-norm 
exists  are  defined  by 

a(t)  m  t2c(l  -  c2)/(l  +  tc)2, 

A(e)  «  (1  —  c2)/(l  +  ec)2,  (3.8) 

c(e)  m  c  —  const.,  0  <  c  S  t. 

They  represent  a  one-parameter  subfamily  of  the  two-parameter  family  of  all 
p  m  k  m  2-formulas  defined  by  (3.3),  subject  to  the  constraint  (3.6). 

In  analyzing  A-contractivity  in  the  max-norm  for  k  m  2,  the  inequality  (2.4)  was 
squared  twice  to  obtain  an  equivalent  rational  condition  in  the  coefficients.  Subject  to 
the  constraints  for  second-order  accuracy  and  Ag-contractivity,  the  latter  turns  out  to 
define  the  same  one-parameter  subfamily  (3.8)  of  the  two-parameter  family  of  all 
p  m  k  m  2-formulas  as  does  the  contractivity  analysis  in  inner  product  norms  (except 
that,  from  the  viewpoint  of  A-contractivity  in  the  max-norm  c(e)  need  not  be  con¬ 
stant). 

1 

In  [13]  the  particular  formula  (2.3)  was  derived  by  minimizing,  over  all  Ag-contractive 
p  m  k  m  2-formulas,  a  bound  for  the  global  error  generated  by  applying  the  OL- 
implementation  of  any  such  formula  to  x  ■  A (r)x,  A  (r)  <-a,  for  some  arbitrarily  small 
a  >  0.  The  objective  function  whose  minimization  led  to  (2.3)  was  |  c3 1  /y,  where  c3 
is  the  error  constant  and  y  is  defined  by  (2.3).  As  an  example  of  an  A-contractive 
formula,  we  give  the  one  minimizing  the  same  objective  function  over  all  A-contractive 
p  m  k  *  2-formulas  [15]: 


— x  -— X  ,-— x  — x  +  —  x  .  +  —x  -  0. 

6  "  6  "  1  6  "  2  \  9  "  9  "  1  9  n"2/ 


(3.9) 


The  formula  (3.9)  is  associated  with  a  a  0,  b  «■  —  and  c  «  — .  Its  variable-step 

9  3 


2 

extension  (3.1)  is  defined  by  c«y. 


*«  -  f A" +  iA-«- 


(3.10) 


and  by  (3.3)  with 


a  “  a(*«)  *  10*j|/t3(3  +  2e(l)2], 
i  ■  *(«»)  ■  5/(3  +  2e  )2, 


(3.11) 


and  ith  tH  defined  by  (3.4).  The  error  constant  of  this  variable-step  formula  (with 

A 

respect  to  hn)  can  be  computed  from  the  general  expression 


c3  -  -  y(  -  “3<*o  +  »3<«2>-y(“20o  +  v202> 


(3.12) 


which  is  valid  for  any  p  m  k  •  2-formula;  here 


«-«„•=  A„-t/*»-(l-e)/(l  +  ec), 

W-V=  *„/*«•(*  +  0/0  +  «0. 


(3.13) 


and  again  c  «  2/3  for  (3.9). 


For  uniform  steps,  the  p  -  *  -  2  Backward  Differentiation  Formula  (BDF)  (2.8)  is 
A-stable  and  thus  G-contractive  as  stated  above.  However,  it  is  not  a  member  of  the 
family  (3.8)  for  *  -  0  and  its  variable-step  extension  (normally  defined  by  setting 
bi*  m  b2.»  "  0)  is  not  contractive  in  any  fixed  G-norm.  In  fact,  the  BDF  was  shown 
[22,  24]  to  become  unstable  for  problems  of  type  (1.7)  with  marginally  stable,  oscilla¬ 
tory  solutions  of  increasing  period  and  for  geometrically  increasing  step  sequences  with 
a  fixed  number  of  steps  per  period.  For  similar  problems  with  decreasing  period  and 
steps,  the  BDF  was  stable  but  overdamped.  By  contrast,  the  OL-method  associated 
with  the  variable-step  version  of  (3.9)  was  not  only  stable  for  both  problems  but  gave 
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a  much  more  accurate  amplitude  response  than  the  BDF. 

b.  A-contractivity  of  second-order  multistep  formulas  with  variable  steps' 
Consider  the  k- step  formula  (1.8)  written  in  terms  of  the  leading  step,  hn,  and  let 

Oj  «■  Oj,n:~  j  m  0,  1, k. 


so  that  0Q  m  0  and  0,  ■*  1  by  definition.  For  k  —  2,  d2  ■>  2/(1  +  e)  where  e  is 
defined  by  (3.4).  For  uniform  grids,  0y  ■  j.  In  terms  of  the  weighted  moments 


where  m  is  any  integer  >  0,  the  constraints  for  />,A-order  accuracy  of  (1.8)  are  [18] 

AQ-  0,  Am  -  mBm_v  m  m  1 . p  (3.16) 


and  the  error  constant  (with  respect  to  hn)  is  given  by 

+ 1)S'1'  <3-,7> 

The  squaring  technique  used  in  [22]  to  analyze  max-norm  A-contractivity  for  k  «■  2  is 
impractical  for  k  >  2.  But  another  approach  given  in  [25]  is  applicable  to  arbitrary  k: 
subject  to  (2.2)  and  for  ay»*0  one  can  write  (2.4)  in  the  form 

F(v):=  +  (bji,/aj)\  >0. 

j-o 


(3.18) 


By  consistency,  F(v) 


■jfil  +  0(tj2),  and  thus 

F:=  £  <*;/«,)  S  0 

j-0 


'  (3.19) 


is  necessary  for  (3.18)  to  hold.  But  it  is  easy  to  prove  that  second-order  accuracy 
implies  F  £  0.  Thus  at  best,  F  m  0.  For  any  given  fixed  aj  (satisfying  the  consisten¬ 
cy  relations),  F  is  a  quadratic  function  of  the  which  takes  a  unique  maximum. 


identically  in  the  aJt  for 


max 


o. 


(3.20) 


bj  -  (0y-j/<2)(-a;),  j  «  0,  1, ....  *. 


(3.21) 


Thus  the  formulas  defined  by  (3.21)  do  satisfy  the  necessary  condition  (3.19)  and  for 
0  no  other  formulas  will. 

One  finally  proves  that,  Subject  to  Ag-contractivity  and  second-order  accuracy,  (3.19) 
is  also  sufficient  for  (3.18)  to  hold,  and  thus  for  A-contractivity.  This  is  done  by 
squaring  (3.18)  once  and  by  majoring  the  remaining  irrational  terms,  which  are 
geometric  means  of  any  two  of  the  radicands,  by  the  corresponding  arithmetic  means. 
The  result  is  (3.19). 


From  the  consistency  relations  and  normalization,  A0  -  0  and  Ax  -  BQ  »  1,  it  follows 
that 


J- 2 


(3.22) 
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and  thus  the  contractivity  condition  (2.2)  at  q  » 0  defines  a  simplex  in  the 
( k  -  1) -dimensional  space  of  the  parameters  aj,  j  •  2, ....  k,  whose  vertices  are  the 
origin  and  the  intersection  points  {  -  «  ■  -  l/Bj,  at  m  0,  i+j,j  —  2, ....  Ac}'  of  the 
dyaxes  with  the  plane  <2,-0.  One  immediately  verifies  that  these  extreme  points 
represent,  respectively,  the  Trapezoidal  Rules  with  step  lengths  r„_y  —  BjhH, 
j  m  l, ....  Ac. 

From  the  above  it  follows  that  all  p  «  2,  Ac-step  formulas  which  are  A-contractive  in 
the  max-norm  are  members  of  the  (Ac  -  1) -parameter  sub-family  (3.20)  of  the 
(2Ac  -  2)-parameter  family  of  all  p  -  Ac  -  2-formulas,  with  the  parameters  { a2 , ....  ak] 
representing  any  point  in  the  above  mentioned  simplex.  A  particularly  interesting  case 
is  p  m  2,k  m  3,  in  view  of  the  fact  that,  for  evaluating  the  local  error  of  a  second- 
order  method,  at  least  three  backward  data  must  be  available  at  every  integration  step. 
In  this  case,  the  above  construction  provides  a  two-parameter  family  of  A-contractive 
formulas  for  arbitrary  step  sequences. 
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A  Survey  of  Rungc-Kutta  Methods 
for  the  Numerical  Integration  of  Stiff  Differential  Systems* 


1 .  Introduction 

A  q-stage  Runge-Kutta  formula  for  the  numerical  integration 
of  the  initial  value  problem 


»  f(x,y),  y(xQ)  =  yQ,  ye  «s 


(1.1) 


can  be  written  in  the  general  form 


y  .  -  y  =  h  I  b.k. 
n+l  i«i  1  1 


(1.2a) 


f  (x  ♦  c.h,  y 


♦  h  I  a..k.),  1  <  i  <  q, 
n  j»l  ^  ’ 


(1.2b) 


ufcere 

Such  formulae  can  be  represented  conveniently  by  the  arrays 


(1.3) 


Classically  all  Runge-Kutta  formulae  were  explicit,  i.c.  a..  *  0 
for  j  >  i,  but  they  became  interesting  for  the  numerical  integra¬ 
tion  of  stiff  differential  systems  with  the  introduction  of  fully 
implicit  Rungc-Kutta  formulae  by  Butcher  (1964).  Butcher  showed 
that  for  all  q  there  exist  fully  implicit  q-stage  Runge-Kutta 
formulae  of  order  2q  and  lihlc  (1969)  has  shown  that  all  of  these 
maximal  order  formulae  are  A-stablc.  Thus,  amongst  the  class  of 
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implicit  Runge-Kutta  formulae  we  have  the  possibility  of  deriving 
A-stable  methods  of  arbitrarily  high  order  whereas  it  is  well  known 
from  a  celebrated  result  of  Dahlquist  (1963)  that  the  highest 
attainable  order  of  an  A-stable  linear  multistep  method  is  limited 
to  two.  In  addition  to  this,  the  pioneering  work  of  J.C.  Butcher 
(1963,  1965)  has  led  to  the  development  of  a  general  algebraic 
framework  which  allows  the  of  quite  high  order  Runge- 

Kutta  formulae  in  a  comparatively  straightforward  manner. 

One  of  the  main  arguments  against  the  use  of  fully  implicit 
Runge-Kutta  formulae  was  on  the  grounds  of  the  amount  of  computa¬ 
tional  effort  required  to  solve  (1.2b)  for  the  k^.  If  (1.2)  is 
applied  to  a  stiff  system  of  ordinary  differential  equations  it  is 
necessary  to  solve  the  resulting  system  of  algebraic  equations, 
defining  the  k^  using  some  form  of  Newton  iteration.  The  system 
of  algebraic  equations  to  be  solved  is  of  size  qs  and  so  a  modified 
Newton  iteration  scheme,  if  applied  in  the  most  obvious  and  naive 
way,  will  for  large  s  require  the  order  of  y  q3s3  multiplications 
to  obtain  the  required  solution.  This  is  about  q3  times  as  much 
work  as  is  required  to  solve  the  algebraic  equations  arising  from 
the  use  of  a  linear  multistep  method.  It  follows  that  if  these 
two  classes  of  methods  are  compared  on  this  basis,  the  immediate 
conclusion  is  to  reject  fully  implicit  Runge-Kutta  formulae  in 
favour  of  linear  multistcp  methods.  However,  because  of  the 
inherent  stability  of  some  classes  of  implicit  Runge-Kutta  formulae 
coupled  with  the  desirability  of  having  high  order  single  step 
integration  methods,  there  has  been  a  large  amount  of  research 
into  the  possibility  of  overcoming  these  computational  difficulties 
Broadly  speaking,  research  into  finding  efficient  high  order 


implicit  Runge-Kutta  methods  has  followed  two  main  directions: 

(1)  The  investigation  of  the  use  of  transformation  methods 
to  obtain  a  solution  of  the  algebraic  equations  de¬ 
fining  the  k.  in  an  efficient  manner. 

(2)  The  derivation  of  different  classes  of  implicit  Runge- 
Kutta  formulae  which  do  not  call  for  the  solution  of 

a  system  of  qs  simultaneous  algebraic  equations. 

In  what  follows  we  shall  survey  some  of  the  recent  results  con¬ 
cerned  with  Runge-Kutta  formulae.  The  literature  on  implicit 
Runge-Kutta  formulae  is  very  large  and  an  attempt  to  cover  it 
fully  in  a  single  chapter  has  proved  impossible.  Instead,  what 
we  have  done  is  to  gather  together  those  results  which  we  think 
will  have  a  significant  effect  on  the  way  in  which  Runge-Kutta 
codes  will  be  developed  in  the  near  future. 

2.  Stability  Requirements  for  Implicit  Runge-Kutta  Formulae 

If  the  Runge-Kutta  formula  (1.2a,b)  is  applied  with  a  fixed 
stepsize  h  to  the  scalar  test  equation 

*  Ay,  A  €  C,  ReU)  <  0  (2.1) 

we  obtain  the  relation 

yn+1  =  R(z)yn>  s  *  hA  (2.2a) 

where 

R(z)  »  1  ♦  zbT(I  -  zA)_1e,  e  =  [  1 , 1 ,  „  . , I ]T,  (2.2b) 

M 

and  where  I  is  the  q  x  q  unit  matrix. 


# 

Here  R(t)  is  a  rational  function  of  2  with  both  the  numerator  and  the 
denominator  having  maximum  degree  q.  The  complex  number  2  lies 
inside  the  region  of  absolute  stability  of  (1.2)  if  |R(z) |  <_  1.  The 
first,  and  still  most  widely  used,  stability  criterion  for  Runge- 
Kutta  formulae  applied  to  stiff  differential  systems  is  that  of 
A-stability  due  to  Dahlquist  (1963). 

Definition  1 

A  numerical  method  is  said  to  be  A- stable  if  its  region  of 
absolute  stability  contains  the  whole  of  the  left-hand  half-plane  Re(z)< 
A  stronger  condition,  which  ensures  that  the  method  has 
the  correct  damping  at  z  «  -  «,  is  that  of  L-stability  due  to  Ehle 
(1969). 

Definition  2 

A  Runge-Kutta  formula  is  said  to  be  L-stable  if  it  is  A-stable 
and,  in  addition, 

lim  |R(z) i  =  0.  (2.3) 

Re(2)=-«® 

The  A-stability  criterion  was  originally  developed  for  linear  multi- 
step  methods  but  has  been  widely  applied  to  Runge-Kutta  formulae. 

Many  results  arc  known  concerning  the  conditions  under  which  the 
rational  function  R(2)  has  modulus  less  than  unity  for  all  2  in  the 
complex  left-hand  half-plane.  (Ehle  (1969)  calls  such  a  property 
A-acccptability  and  if,  in  addition,  (2.3)  holds,  then  R(2)  is 
said  to  be  L-acceptable.)  In  particular,  it  is  known  that  if  R (z ) 
is  a  diagonal  of  the  Padd  table  fc.*  e1,  then  R(z)  is  A-acceptable 


(Birkhoff  and  Varga  (1965)).  Furthermore,  if  R(z)  lies  on  one  of 
the  two  subdiagonals  then  R(z)  is  L-acceptable  (Ehle  (1969)). 
Runge-Kutta  formulae  which,  when  applied  to  (2.1),  give  rational 
approximations  of  this  type,  have  been  investigated  by  Axelsson 
(1969),  Chipman  (1971)  and  Ehle  (1969).  However,  the  investigation 
of  the  A-acceptability  of  rational  approximations  to  ez  remains  a 
difficult  task  although  there  have  recently  been  some  important 
advances  in  this  area  (see,  for  example,  Ntfrsett  (1975),  Iserles 
(1979),  Wanner,  Hairer  and  Mrsett  (1978)).  In  particular,  we 
mention  the  concept  of  order  stars  developed  by  Wanner  et  al.  which 
is  fast  becoming  a  very  important  tool  in  the  theory  of  approxima¬ 
tion. 

Although  the  criterion  of  A-stability  has  proved  to  be  a  very 
valuable  one,  particularly  in  helping  us  to  discard  those  methods 
which  are  not  promising  for  integrating  stiff  systems,  it  has  the 
obvious  limitations  that  the  model  test  equation  (2.1)  is  linear, 
homogeneous  and  has  constant  coefficients.  Several  authors  have 
given  examples  of  stiff  equations  for  which  a  particular  A-stable 
method  with  a  certain  variable  stepsize  gives  a  violently  unstable 
solution  (see,  for  example,  Stetter  (1973,  p.  181)).  A  quite 
widely  used  generalisation  of  A-stability  is  that  of  S-stability  due 
to  Prothero  and  Robinson  (1974).  This  is  associated  with  the 
inhomogeneous  test  equation 

y*  *  g'(x)  ♦  X(y  -  g(x)}  .  (2.4) 

Prothero  and  Robinson  sought  to  categorise  those  one-step  methods 
which  give  a  stable  numerical  solution  when  applied  with  a  step- 


u 


length  h  to  any  equation  of  the  form  (2.4)  where  X  is  a  complex  constant 
with  negative  real  part  and  where  g'(x)  is  any  function  that  is  defined 
and  bounded  in  some  interval  x  €  [xo>x].  They  define  the  concept  of 
S-stability  in  the  following  way. 


Definition  3. 

A  one-step  numerical  method  is  said  to  be  S-stable  if,  for  a 
differential  equation  of  the  form  (2.4)  and  for  any  real  positive 
constant  XQ,  there  exists  a  real  positive  constant  hQ  such  that 


(2.5) 


f(y(x)) 

and  is  defined  by  Butcher  (1975)  in  the  following  way. 

Definition  4 

Let  yn_i*yn»-**>  Zn-l'Zn’“‘  two  secluences  approximate 
solutions  of  (2.5)  computed  by  an  implicit  Runge-Kutta  method  using 

M 

the  same  stepsize  h.  Let  <  •,•  >  denote  a  scalar  product  on  <fl‘  and 
||.||  the  corresponding  norm.- 'The  method  is  defined  to  be  B-stable 
if,  for  any  f  satisfying 

<  f(u)  -  f(v),  u-v  >  0  for  all  u,v  e  (2.6) 

it  holds  that  Ijy^zJI  1  i lyn-i“zn-l ^  ^ ’ 

This  condition  was  further  extended  by  Burrage  and  Butcher 
(1979)  to  the  nonlinear  system 

y’  =  f(x,y(x)),  f:flN+1-«N  (2.7) 

satisfying  the  monotonicity  condition 

<  f(x,y)  -  f(x,z) ,  y-z  >  <_  0  for  all  y,z  e 

and  all  x  e  Si.  (2.8) 

Associated  with  the  test  equation  (2.7),  Burrage  and  Butcher  (1979) 
give  the  following  definition  of  BN-stability. 

Definition  5 

Let  (yn) , (zn)  be  two  sequences  of  approximations  to  the  solution 
of  (2.7)  computed  by  (1.2a,b)  using  a  fixed  step  h.  If 


then  the  method  is  said  to  be  BN-stable. 

Condition  (2.9),  which  with  slight  modifications  is  equivalent 

to  the  concept  of  contractivity  used  by  Nevalinna  and  Liniger  (1978), 

is  stronger  than  that  of  A-stability  since  A-stability  requires  only 

that  (  | y  -2  ||  is  bounded  as  n  ■*■  «.  Burrage  and  Butcher  give  the 
n  n 

following  sufficient  condition  for  BN-stability: 

Consider  the  quadratic  form 

Q(0,,6_,..,0  )  =  L'  m..9.0.  where  m.  .  =  b. a. .♦b .a. . -b.b . . 

12  q  •  .sl  ’Ji)  lj  l  ij  j  n  l  i 

If  the  method  (1.2a,b)  is  such  that  b^  >_  0  for  1  i  <_  q  and  Q  is 
non-negative,  then  (1.2)  is  BN-stable.  This  leads  to  the  following 
definition  of  algebraic  stability  due  to  Burrage  and  Butcher  (1979). 

Definition  6 

T 

A  Runge-Kutta  method  which  is  such  that  b^  >_  0  and  c  Me,  where 

M  =  a  non-negative  form,  is  said  to  be  algebraically  stable. 

This  condition  has  been  given  independently  by  Crouzeix  (1979)  7)i£. 

conJ«ltoq.cf  O^uivalent  to  the  A-contractivity  tonJitica  cf  NevaLvm 

Dahlquist  and  Jectsch  (1979)  als c  observe  that  it  is  necessary  to  have 

b.  >  0  for  all  i  since  if  one  of  the  b.  is  zero  we  have  m. .  =  0  and 
i  in 

the  non-negative  definiteness  of  M  implies  that  the  iC*1  row  of  M 
must  be  zero  and  the  method  becomes  reducible.  Burrage  and  Butcher 
(1979)  have  shown  that  if  the  Runge-Kutta  formula  is  non-confluent 
(i.e.  Cj,C2»...»Cq  are  distinct)  then 

algebraic  stability<  =  >  BN-stability. 

A  further  interesting  result  has  been  proved  by  Utindsdorr 


BD-A122  170 
UNCLASSIFIED 


PROCEEDINGS  OF  THE  INTERNATIONAL  CONFERENCE  ON  STIFF  473 

CONFUTATION  APRIL  12..  <U>  UTAH  UNIV  SALT  LAKE  CITV  DEPT 
OF  CHEMICAL  ENGINEERING  R  C  AIKEN  1982 

AF0SR-TR-82-1836-V0L-2  AFOSR-82-0B38  F7G  1271  NL 


F7G  1271 


Spijker  (1981)  who  show  that  for  any  irreducible  Runge-Kutta  formula 
(see,  for  example,  Stetter  (1973)),  which  is  not  necessarily  non¬ 
confluent,  the  concepts  of  B-,  BN-  and  algebraic  stability  are 
equivalent. 

A  neat  way  of  proving  the  B-stability  of  certain  classes  of  Runge- 
Kutta  formulae  has  been  given  by  Warner  (1976)  who  shows  that  the 
implicit  Runge-Kutta  formulae  based  on  Gaussian  points  and  Ehle's  11^ 
methods  based  on  Radau  points  arc  B-stable  by  using  the  well  known 
fact  that  these  particular  Runge-Kutta  formulae  are  equivalent  to 
collocation  methods  (WTight  (1970)).  This  technique  has  recently 
been  extended  by  Njirsett  and  Wanner  (1981)  to  include  other  classes 
of  Runge-Kutta  formulae.  The  problem  of  classifying  classes  of 
algebraically  stable  Runge-Kutta  formulae  has  been  considered  by 
Burrage  (1978b).  He  shows  that  the  q-stage  methods  of  order  2q 
are  all  algebraically  stable  and  has  given  a  classification  of  all 
algebraically  stable  q-stage  Runge-Kutta  formulae  of  order  2q-Z  which 
are  non-confluent.  However,  Burrage  makes  the  point  that  such  a 
classification  is  much  harder  for  lower  order  formulae. 

In  conclusion  we  can  say  that  in  the  past  few  years  there  has 
been  considerable  development  in  the  stability  analysis  of  Runge- 
Kutta  formulae  applied  to  nonlinear  stiff  differential  systems.  The 
condition  of  algebraic  stability  has  two  major  advantages  to  recom¬ 
mend  it  over  A-stability.  Firstly,  it  seems  likely  that  an  alge¬ 
braically  stable  Runge-Kutta  method  will  be  superior  for  nonlinear 
stiff  systems  to  one  which  is  only  A-stable.  Secondly,  it  is  pos¬ 
sible  to  give  an  algebraic  condition  for  algebraic  stability  (i.e. 
one  depending  only  on  the  coefficients  of  the  Runge-Kutta  method) . 


Because  of  this,  algebraic  stability,  and  the  closely  related 
concept  o F  BN-stability,  should  play  an  important  role  in  the 
future  development  of  new  Runge-Kutta  formulae. 


3.  Fully  Implicit  Runge-Kutta  Formulae 

It  was  mentioned  in  the  introduction  that  the  main  objection 
to  implementing  fully  implicit  Runge-Kutta  formulae  has  tradition¬ 
ally  been  on  the  grounds  of  the  amount  of  computational  effort 
required  to  solve  the  nonlinear  equations  resulting  from  a  modified 
Newton  iteration.  Algorithms  to  overcome  this  problem  for  a  special 
class  of  Runge-Kutta  formulae  have  been  given  by  Butcher  (1976)  and 
for  more  general  formulae,  including  the  maximal  order  ones  based  on 
Gaussian  points,  by  Bickart  (1977)  and  tfarah  (1979).  These  algorithms 
are  all  based  on  transformation  methods  and  in  what  follows  we  shall 
describe  Butcher's  approach  since  this  has  already  been  implemented 
in  a  successful  computer  package. 

Consider  the  solution  of  the  differential  system 


y'(x)  *  f(y(x)) 


(3.1) 


using  the  q-stage  formula  (1.2).  The  numerical  solution  at  the  point 
xn  *  xn_j+h  is  computed  using 


y 


n 


‘1 

♦  h  Z  b.f (Y.) 
j=l  J  J 


(3.2a) 


To  evaluate  ,  Y2>...,Y^  satisfying  (3.2b)  we  use  a  modified  Newton 
iteration  scheme  so  that,  at  the  end  of  a  correction  iteration,  Y^  is 


replaced  by  Yi  ♦  uk.  Th®  increments  u^  satisfy 


q 

u.  -  h  L  a. .Ju.  -  Z.  ■  0 
i  j.l  «  3  i 


1  <  i  <  q 


(3.3a) 


where  J  is  the  s  x  s  Jacobian  matrix  evaluated  at  an  appropriate 
point  and 


q 

♦  h  Z  a. .f (Y.) , 

j-1  3  3 


1  <  i  <  q. 


(3.3b) 


Let  M  ■  I  ©  I  -  hA  ©  J  be  the  matrix  of  coefficients  in  (3.2)  where 
I  is  q  x  q,  I  is  s  x  s  and  ©  denotes  a  tensor  product.  Relation  (3.3a) 
can  then  be  written  as 


Mu  -  Z  »  0  (3.4) 

for  the  appropriate  vectors  u,  Z  and  the  matrix  M. 

We  assume  that  system  (3.4)  is  to  be  solved  for  u  in  the  usual 
way  by  first  LUL decomposing  the  matrix  M.  The  number  of  multiplica¬ 
tions  required  to  carry  out  this  decomposition  is  Cs'Va  ♦  0(s“)  for 

*  2 

large  s  and  for  the  back  substitution  we  require  Ds  ♦  0(s)  multipli- 
3  2 

cations  where  C  *  q  and  D  ■  q  .  The  idea  behind  Butcher’s  approach 
is  to  solve  a  suitably  transformed  system  of  equations  so  that  the 
factors  C  and  D  are  considerably  lowered. 

Let  P  and  Q  be  non-singular  q  x  q  matrices  so  that 


u  «  (Q_1  ©  I)u,  z  -  (P  ©  I)Z. 


Then  M  ■  (P  ©  I)M(Q  ©  I)  -  PQ  ©  I  -  hA  ©  J,  where  A  ■  PAQ.  It 


immediately  follows  that  (3.4)  is  equivalent  to  the  transformed 
system 

Mw  -  Z  »  0.  (3.5) 

Suppose  now  that  the  Jordan  canonical  form  of  A"1  is 


0  if  A.  t  A.  , 
x  1*1 


f  if  A. 
A.  l 

l 


A.  , 
l+l 


and  set  D  «  diag^.A^ - ,Aq),  P  «  DT'V"1,  Qa  T.  Butcher  (1976) 

shows  that  in  the  case  where  all  the  \j  are  real  and  equal  we  have 
C  *  1,  D  «  q.  This  is  a  result  of  great  practical  significance 
because  it  says  that  for  a  q-stage  implicit  Runge-Kutta  formula 
whose  defining  matrix  has  just  one  real  q-fold  eigenvalue  the  com¬ 
putational  effort  required  to  solve  the  algebraic  equations  arising 
from  the  application  of  a  modified  Newton  iteration  scheme  decreases 
from  q^s^/3  +  O(s^)  to  s^/3  ♦  O(s^)  multiplications  for  large  s. 

The  obvious  question  now  is  whether  there  exist  implicit  Runge- 
Kutta  formulae  having  this  special  property.  This  question  was 
answered  in  the  affirmative  by  Ndrsett  (1976)  who  showed  that  formulae 
of  this  type  can  be  constructed  by  the  method  of  collocation 
using  the  ratio  between  zeros  of  certain  Laguerre  polynomials  as 
collocation  points.  The  class  of  methods  derived  by  Ndrsett  was 
extended  by  Burrage  (1978a).  The  family  of  Runge-Kutta  formulae  of 
order  q,  or  greater,  given  by  Burrage  is 


V  A  V"1 

qqq 


bl  b2 


>*“«  C*Vb2 . V  '  (1>? . W'  V<1  ’ 


'0  0  0 
1  0  0 
0  \  0 
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0  a 
0  a 
0  a 


iq 

2q 

3q 


• — r  « 
q-1  qq 


1...  .c 


i  cq_1 


q-1 

1 
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q  -» 


“kq  “  (-l)q'k(kq-l]fel-l}IXq"k*I/(k-l)I,  1  ik  <  q  and  where  X  is 
real  and  non-zero.  Burrage  (1978a)  defines  the  concept  of  a  trans¬ 
formed  Runge-Kutta  method  and  then  gives  the  following  definition. 


Definition  7 

A  transformed  method  of  order  q  or  greater  whose  Runge-Kutta 
matrix  has  just  one  real  q-fold  eigenvalue  is  called  a  singly  implicit 
method . 

Burrage  also  proved  that  the  maximum  attainable  order  of  a 
singly  implicit  Runge-Kutta  method  with  q  stages  is  q*l.  The  con¬ 
nection  between  these  formulae  and  the  formulae  of  Ndrsett  (1976) 

comes  from  the  observation  that  if  z,,z-,...,z  are  the  zeros  of  the 

1  2  q 

qtb  degree  Laguerre  polynomial 

L  (z)  ■  t  (-i)j(})zj/j! 

4  j*0 


«H 


then  the  singly  implicit  Runge-Kutta  method  of  Burrage  is  such  that 


c^  *  Az^,  1  <  i  <  q,  where  A  is  the  single  ^,-fold  eigenvalue  of  A  , 
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The  final  remaining  step  was  to  derive  explicitly  the  transformation 
matrices  required  to  implement  these  singly  implicit  formulae  and 
this  was  done  by  Butcher  (1979). 

The  importance  of  singly  implicit  Runge-Kutta  formulae  from  an 
algorithmic  point  of  view  is  that  it  is  possible  to  derive  a  whole 
class  of  formulae  of  increasing  order  and  that  for  each  order  q  it  is 
possible  to  derive  an  embedded  formula  of  order  q+1  which  is  used  for 
the  purpose  of  local  error  estimation.  This  has  led  to  the  develop¬ 
ment  of  the  program  STRIDE  due  to  Butcher,  Burrage  and  Chipman  (1979a, b) 
which  is  based  on  the  singly  implicit  formulae  of  Burrage.  STRIDE 
is  a  variable  stcp/variable  order  program  which  allows  the  use  of 
formulae  of  orders  1(1)15  all  of  which  are  A(a)-stable  with  a  >83°. 

The  implementation  details  of  these  formulae  arc  too  numerous  to  des¬ 
cribe  here  but  are  fully  described  in  Butcher,  Burrage  and  Chipman 
(1979a).  Although  STRIDE  still  does  not  seem  to  be  generally  com¬ 
petitive  with  codes  based  on  backward  differentiation  formulae  (see 
also  Gaffney (1982)  for  further  comments)  it  should  be  remembered  that 
linear  multistep  methods  have  benefited  from  a  vast  amount  of  testing 
and  re-programming.  It  is  therefore  quite  possible  that  the  gap  between 
the  performance  of  BDF  and  R-K  methods  will  continue  to  decrease  as 
more  experience  is  gained  with  STRIDE  and  its  strengths  and  weaknesses 
become  better  understood. 


4.  Diagonally  Implicit  and  Mono-Implicit  Runge-Kutta  Methods 

Closely  related  to  the  singly  implicit  Runge-Kutta  formulae 
implemented  in  STRIDE  is  the  class  of  diagonally  implicit  Runge-Kutta 
formulae.  This  class  of  formulae  was  originally  proposed  by  Ndrsett 
(1974)  and  was  further  developed  by  Alexander  (1977)  and  Crouzeix 
(Sur  1 'approximation  des  Equations  diffdrentielles  opdrationnelles 
lindaires  par  des  mdthodes  de  Runge-Kutta,  Thesis,  University  of 
Paris  VI,  Paris,  1975).  A  diagonally  implicit  Runge-Kutta  formula 
is  one  whose  defining  matrix  A  is  lower  triangular.  As  a  result, 
the  use  of  a  Newton  iteration  scheme  to  solve  for  the  associated 
with  these  methods  calls  for  the  solution  of  q  sets  of  s  algebraic 
equations.  Normally  these  methods  are  constructed  so  that  the  diagonal 
elements  are  all  equal,  called  DIRK  methods  by  Alexander  ind  SDIRK 
by  others,  but  formulae  where  the  diagonal  elements  aTe  "almost” 
equal  also  seem  worthy  of  study. 

Alexander  proved  that  a  q-stage,  A-stable  DIRK  formula  is  strong¬ 
ly  S-stable  if  a^  *  b^,  1  <  i  <  q,  and  c^  ■  1.  In  Alexander  (1977) 

he  derived  strongly  S-stablc  DIRK  formulae  of  order  2  in  2  stages, 
order  3  in  3  stages  and  showed  that  it  is  impossible  to  derive  a 
strongly  S-stable  DIRK  formula  of  order  4  in  4  stages.  Cash  (1979) 
gave  a  strongly  S-stable  DIRK  formula  of  order  4  in  5  stages  and 
Cooper  and  Sayfy  (1979)  gave  one  of  order  5  in  6  stages.  In  Alexan¬ 
der's  paper  some  numerical  results  are  given  which  indicate  that 
DIRK  formulae  can  in  some  cases  be  competitive  with  linear  multi- 
step  methods  especially  when  low  precision  is  requested.  However, 
Alexander,  and  others,  have  pointed  out  that  efficient  erroT  estima¬ 
tion  and,  more  particularly,  change  of  order,  is  a  problem  with  DIRK 
formulae  since  it  seems  difficult  to  derive  families  of  DIRK 
formulae  suitable  for  inclusion  in  a  VSVO  algorithm. 


There  are  several  important  theoretical  results  known  con¬ 
cerning  the  maximum  attainable  order  of  q-stage  DIRK  formulae. 

Nfirsett  (1974)  has  shown  that  the  maximum  order  attainable  by  a 
DIRK  formula  with  q  stages  is  generally  q  1  but  if  q  «  2u, 

2  ±  v  i.  10,  this  maximum  order  is  q.  Ndrsett  and  Wolfbrandt  (1977) 
have  given  an  important,  and  somewhat  surprising,  result  concerning 
singly  implicit  Runge-Kutta  formulae  and  DIRK  formulae  in  cases 
where  all  the  diagonal  elements  of  the  defining  matrix  A  arc  not 
necessarily  equal.  They  examine  rational  approximations  of  the  form 

m  .  n 

E  a.z1/  tr  (1  ♦  y.z)  to  e"z  where  z  e  (C,Yi  e  (4.1) 

i*0  1  i*l  1  1 

and  show  that  the  maximum  attainable  order  is  m+1  with  the  least 
absolute  value  of  the  error  constant  being  when  Yj  ■  •  ...  *  Yn- 

This  result  immediately  implies  the  result  of  Ndrsett  that  the  order 
of  a  q-stage  semi-implicit  Runge-Kutta  formula  cannot  exceed  q+1. 

An  additional ,  rather  negative  result  from  the  point  of  view  of  DIRK 
formulae,  has  been  given  by  Hairer  (1980a)  who  has  shown  that  the 
order  of  an  algebraically  stable  DIRK  formula  cannot  exceed  four. 

The  computational  aspects  of  DIRK  formulae  have  not  received 
much  attention  so  far.  The  step  control  procedure  used  by  Alexander 
(1977)  was  based  on  Richardson  extrapolation.  However,  in  view  of  the 
wide!*  used  technique  of  embedding  for  explicit  Runge-Kutta  formulae 
(Fehlberg  (1964))  it  was  a  natural  progression  for  the  error  estima¬ 
tion  in  DIRK  formulae  to  be  carried  out  using  pairs  of  embedded 
formulae  with  orders  differing  by  one.  Ndrsett  (1974)  derived  some 
low  order  embedded  DIRK  formulae  and  Cash  (1979)  extended  this  to  derive 
a  third  order  DIRK  formula  in  three  stages  and  a  fourth  order  one  in 
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five  stages,  both  of  which  are  strongly  S-stable  and  contain  an 
embedded  formula  of  one  order  lower.  Present  implementations  of 
DIRK  formulae  often  use  fixed  order  methods.  There  has  not  been 
any  extensive  testing  of  DIRK  formulae  to  date  although  a  research 
level  code  due  to  Alexander  has  performed  well  in  the  integration  of 
a  certain  class  of  oscillatory  problems  (Gaffney  (1982')).  Also  a 
DIRK  code  SIRKUS  has  been  given  by  Ndrsctt  (1974)  and  a  semi- 
implicit  Runge-Kutta  code  for  large  sparse  systems  has  been  developed 
by  Houbak  and  Thomsen  (1979). 

The  possibility  of  changing  both  order  and  stepsize  efficiently 
with  DIRK  formulae  came  with  the  investigation  of  block  DIRK  formulae. 
Block  implicit  Runge-Kutta  formulae  have  been  around  for  some  time 
(Shampime  and  Watts  (1972) ,  Watanabe  (1978),  Williams  and  dc  lloog 
(1974))  but  generally  these  are  based  on  fully  implicit  Runge-Kutta 
formulae  and  often  they  are  only  proposed  as  a  starting  procedure 
(Gear (1980) ) .  Block  DIRK  formulae  have  been  considered  in  Cash  (1982) 
and  such  formulae  offer  important  computational  advantages  over  con¬ 
ventional  DIRK  formulae.  For  example,  the  second  order  block  formula 
given  by  Cash  is 


at  n  +  3 
at  n  +  2 
at  n  M 


(4.2) 
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This  formula  is  strongly  S-stable  and  gives  second  order  solutions  at 

n+1,  n*2,  n+3  as  well  as  first  Wder  solutions  at  n*l  and  n+2.  It 

can  be  seen  that  (4.2)  gives  second  order  solutions  at  three  step 

points  using  a  total  of  five  stages  so  we  describe  this  formula  as 

2 

being  second  order  and  requiring  "lj  stages  per  step".  Also  given 
by  Cash  is  a  third  order  formula  requiring  2j  stages  per  step,  a 
fourth  order  one  requiring  2y  stages  per  step  and  a  fifth  order  one 
requiring  stages  per  step.  All  these  formulae  are  strongly  S-stable, 
or  very  nearly  so,  and  the  stages  required  per  step  are  considerably 
less  than  for  conventional  strongly  S-stable  DIRK  formulae.  Cash 
also  describes  procedures  for  varying  both  the  order  and  stepsize  of 
these  formulae  and  some  numerical  results  are  given. 

In  Cash  (1982)  it  is  argued  strongly  that  in  the  case  of  implicit 
Runge-Kutta  formulae  it  may  not  be  valid  to  compare  the  efficiency  of 
two  formulae  by  counting  the  number  of  stages.  It  is  clear  that  we 
must  also  take  account  of  the  computational  effort  required  to  evaluate 
the  kj.  This  point  is  highlighted  if  we  consider  an  extrapolation 
method.  The  trapezoidal  rule  using  h  -  y  h  Richardson  extrapolation 
without  smoothing  can  be  written  as 

Vi.iv*  Vh  *  i  <f(ViVi,h>  *  f(vv” , 

Vh  *  yn.U2  *  V 

yn*l/2,W2  *  yn+(i-l)/2lfcfr+4If(VV2*yn+l/2,h/2)  * 

+  f(V(t-l)/2*  yn*(i-l)/2|fr/2)l  >  i  *  1»2,  (4‘3b) 

The  cxtrapola’  "d  solution  yn+^  is  given  by 


(4.3c) 


yn+±  ’  3  (4yn*l,H/2  ’  Vl.h^ 

Formally  this  process  for  computing  yn+1  can  be  written  as  the 
diagonally  implicit  Runge-Kutta  formula 


0 

1 

1 

2 

1 


0 

1_ 

2 

l_ 

4 

1 

4 


1_ 

2 

0 

0 


1_ 

4 

1_  1 

2  4 


I  I  1  I 

6  "  6  3  3 


(4.4) 


We  see  that  this  formula  has  four  stages  but  this  does  not  tell  the 
whole  story.  This  is  because  the  stage  k4  is  likely  to  be  very  cheap 
to  evaluate  since,  when  computing  the  approximation  yn+1  we  al¬ 
ready  have  the  approximations  y^+1  ^  and  y^+J  h  available.  Many 
extrapolation  methods  can  be  regarded  as  high  order  diagonally  implicit 
Runge-Kutta  methods  which  require  more  than  the  minimum  possible 
number  of  stages  to  achieve  a  given  order  but  which  are  such  that 
some  of  the  stages  tire  very  cheap  to  evaluate.  Note,  however,  that 
extrapolation  methods  are  such  that  the  diagonal  elements  for  the 
corresponding  DIRK  method  are  not  all  equal. 

We  now  consider  the  class  of  Mono-Implicit  Runge-Kutta  formulae 
introduced  by  Cash  (1975) .  The  idea  of  introducing  this  class  of 
formulae  came  from  the  observation  that  if  we  take  the  forward  l-uler 


rn+l 


-  y. 


hf 
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rule 


which  has  only  a  small  region  of  absolute  stability,  and  replace  h  by 
-h  we  obtain  the  backward  Euler  rule 
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which  is  known  to  be  L-stable.  This  idea  can  be  extended  by  taking 
any  explicit  Runge-Kutta  formula  and  replacing  h  by  -h  to  obtain  what 
is  called  the  "backward  version"  of  the  Runge-Kutta  formula.  If  the 
explicit  Runge-Kutta  formula  when  applied  with  fixed  h  to  the  equation 
y*  »  Xy  gives 


Vi/y» 


*00. 


2  =  hx. 


and  the  backward  version  gives 

ViA.  ■ 

it  can  easily  be  shown  that 

R(z)  •  .  (4.5) 

This  leads  us  to  the  "reflection  principle"  that  the  stability  region 
of  the  backward  formula  is  the  complementary  set  of  the  image  of  that 
of  the  classical  explicit  formula  reflected  in  the  imaginary  axis. 

For  further  extensions  of  this  idea  see  Stctter  (1973).  This  class  of 
backward  formulae  generally  has  very  good  stability  properties  and  it 
can  be  shown  to  be  a  subset  of  the  more  general  class  of  formulae 
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y  , -  y  =  h  I  b.f(x  ,  y  ) 
‘'n+l  'n  •  „  j  n+a.  7n+o. 


(4.6a) 
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y  *  6.y  *(1-6. )y  +  h  Z  a..f(x  ,y  ) 
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(4.6b) 


If  in  (4.6b)  we  take  m  *  j  -1,  <5^  =  0  we  obtain  a  classical  explicit 
Runge-Kutta  formula.  If  m  *  j,  6^  *  0,  a„  »  6  for  all  j  we  obtain 
a  diagonally  implicit  Runge-Kutta  formula  and  if  m  «  k,  <S .  *  0  we 
obtain  a  fully  implicit  Runge-Kutta  formula.  If,  however,  we  take 
m  •  j  -  1  and  6^  t  0  for  at  least  one  j  we  obtain  a  formula  which  is 
implicit  in  the  single  unknown  y  j.  In  Cash  (197S)  the  general 
class  of  formulae  proposed  was  of  the  form  (4.6a,b)  with 

6j  =  0,  m*  j  •  1,  0  <  j  <  r, 

6j  *  1,  m  *  j  -  1,  a^»0,  r  +  l<_j<_k,0<_i<_r, 

where  r  <_  [ik] .  Some  numerical  testing  of  these  formulae  was  done 
by  Birnbaum  and  Lapidus  (1978)  and  they  were  found  to  perform  well  on 
a  set  of  test  problems  from  a  chemical  engineering  environment.  These 
formulae  were  further  investigated  by  van  Bokhoven  (1980)  who  derived 
the  general  order  relations  to  be  satisfied  by  formulae  of  order  <_  6. 

As  with  fully  implicit  Runge-Kutta  formulae,  the  way  in  which  MIRK 
formulae  are  implemented  is  of  great  importance.  The  system  of  algebraic 
equations  to  be  solved  is  of  dimension  s  but  the  coefficient  matrix  of 
the  modified  Newton  iteration  scheme  is  of  the  form 
t  .  . 

I  o.hV  (4.7) 

i=0  1 

where  J  is  an  approximation  to  the  Jacobian  matrix.  In  Cash  and 
Singhal  (1982)  a  special  class  of  MIRK  formulae  were  investigated 
which  is  such  that  (4.7)  can  be  approximated  by 

(I  -  BhJ)* 

since  in  this  case  no  matrix-matrix  products  are  called  for.  Some 
L-stable  formulae  of  this  class  with  order  <_  4  have  been  given  in 


Cash  and  Singhal  (1982)  and  some  numerical  results  are  presented. 


5 .  Defect  Correction 

The  technique  of  defect  correction  is  a  further  attempt  to  over¬ 
come  the  difficulty  of  solving  large  systems  of  nonlinear  algebraic 
equations  when  applying  high-order  implicit  Runge-Kutta  methods.  The 
basic  idea  behind  the  Iterated  Defect  Correction  (IDeC)  technique  is 
to  obtain  an  approximate  solution  of  the  differential  equation  using 
a  "cheap"  low-order  implicit  R-K  method  and  then  to  improve  this 
approximate  solution  iteratively  by  means  of  a  correction  procedure. 
The  technique  of  IDeC  has  been  given  by  Frank  and  Ueberhuber  (1977, 
1978).  They  show  that  every  IDeC  method  based  on  the  backward  Euler 
rule,  using  piecewise  polynomial  interpolation,  has  a  fixed  point 
which  coincides  with  the  solution  obtained  using  an  appropriate  poly¬ 
nomial  collocation  scheme.  However,  in  general,  the  IDeC  technique 
calls  for  not  much  more  computational  effort  than  is  required  by  a 
linear  multistep  method  to  solve  the  algebraic  equations  arising  from 
a  modified  Newton  iteration.  The  technique  of  IDeC  as  described  by 
Frank  and  Ueberhuber  (1977)  is  as  follows. 

Consider  the  solution  of  the  stiff  differential  system 

Y'  *  f(x,y),  y(0)  *  y0>  0  <_  x  <_  H. 

Define  a  grid 


(xv  *  llcv,  v  «  1  (l)m|0  <  Cj  <  ...  <  Cm  =  1}. 


On  this  grid  apply  the  backward  Euler  rule 
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This  gives  a  solution  nv”''  *  (n^  ',n 
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interpolating  polynomial  P  (x)  of  degree  m  which  interpolates  the 

Jo)  ‘ 


points  Cx  ,nv  1  ,  i.e. 

v  v  v=0 


P°(xv)  -  nj°»v  =  0(l)m  . 


(5-2) 


Having  constructed  this  polynomial  we  can  define  the  defect,  which  is 
a  continuous  function  of  x,  as 


d°fx)  *  i  [P°(x)]  -  f(x,P°(x)) 


(5.3) 


This  allows  the  following  initial  value  problem  to  be  constructed 
y’(x)  *  f (x,y)  ♦  d°(x) ,  y(o)  =  yQ 

2f(x,y)  ♦  ±  [P°(x))  -  f(x,P°(x))  (5.4) 

which  has  the  known  solution  y(x)  *  P°(x).  We  now  solve  the  initial 
value  problem  (5.4)  in  exactly  the  same  way,  i.e.  using  the  backward 
Euler  rule  on  the  same  grid  n,  to  obtain  a  numerical  solution 

T(°)  =  rT«»  T(°)  T(°)) 

t  -  (tq  ,Tl  ). 

Wc  now  use  the  known  discretization  errors  -  P°(xv)  as  estimates 

of  the  unknown  errors  n^  -  y(xy).  This  approach  follows  an  original 
idea  due  to  Zadunaisky  (1976).  We  now  replace  the  unknown  errors 
in  the  identity 

y(xv)  *  -  (n^  -  y(xy)),  v  *  0(l)m 

by  the  known  error  estimates  -  P0(x^).  This  leads  to  the 

following  formula  to  improve  the  first  approximate  solution  : 
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(5.5) 


v  *  0(l)m  , 


Following  an  idea  due  to  Stetter  (1974)  this  whole  procedure  can  be 
used  iteratively  as 


*  nl0)  -  (.“>  -  >jC‘v» 


(5.6) 


where  P^(x)  is  the  polynomial  of  degree  m  interpolating  the  points 
{xv,n^}®BQ.  Subject  to  some  general  differentiability  conditions  on 
the  function  f,  Frank  and  Ueberhuber  (1977)  have  proved  the  following 
result  for  the  IDeC  method  applied  on  an  equi-distant  grid  for  a  fixed 
degree  of  polynomial  m  and  for  h  *  H/m: 

If  an  arbitrary  Runge-Kutta  scheme  of  OTder  p(<_  m)  is  used  and 
if  f  satisfies  suitable  differentiability  conditions  then 


n(J)  -  yCx  )  -  0(h"1"(p()*1)’")). 


Thus  the  technique  of  IDcC  achieves  the  high  order  attainable  by 
implicit  Runge-Kutta  formulae  but  at  a  significantly  less  computation 
cost.  Much  of  the  theoretical  analysis  concerning  IOeC  has  now  been 
completed  (Stetter  (1974),  (1978),  llaircr  (1978),  Frank  and  Ueberhuber 
(1978))  and  this  approach  does  seem  to  be  a  very  promising  one. 

Actual  implementations  of  defect  correction  have  been  largely 
based  on  the  backward  Euler  rule  although  Butcher  (1979b)  has  con¬ 
sidered  the  application  of  defect  correction  to  a  more  general  class 
of  Runge-Kutta  methods.  Ueberhuber  (1979)  has  considered  many  of  the 
computational  details  associated  with  a  particular  implementation  of 
IDeC  but  it  is  clear  that  much  more  experience  is  needed  in  this  area 
before  a  really  successful  implementation  can  be  contemplated. 


6.  Runge-Kutta  Methods  Using  an  Approximation  to  the  Jacobian 
6 . 1  Rosenbrock  Methods 

For  the  numerical  integration  of  the  autonomous  differential 
system 

»  f(y),  y(*0)  -  y0,  (6.i) 


Rosenbrock  (1963)  proposed  the  class  of  q-stage  integration  methods 
defined  by 
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.  Such  formulae  have  the  major  computational 
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advantage  that  it  is  only  necessary  to  solve  linear  systems  of  algebraic 
equations  to  find  the  but  have  the  disadvantage  that  the  exact 
Jacobian  is  required  at  each  step.  In  view  of  this,  Rosenbrock 
methods  are  only  likely  to  be  competitive  with  other  classes  of  methods 
on  problems  for  which  the  Jacobian  matrix  is  not  too  expensive  to 
evaluate.  An  important  class  of  problems  of  this  type  has  been  given 
by  Edsbcrg  (1974).  Udsberg  considered  problems  where  the  elementary 
steps  of  some  composite  reaction  taking  place  in  a  homogeneous 
solution  according  to  the  mass  action  law  are  known.  In  such  cases 
the  system  of  O.U.E.s  describing  the  kinetic  behaviour  of  the  system 


1 


can  be  set  up  from  the  coefficients  and  the  structure  of  the  reactions. 
Edsberg  showed  that  such  problems  can  often  be  written  in  the  form 

y*  »  Ap,  y(o)  given,  (6.3) 


where  A  is  an  M  x  N  matrix  with  integer  entries  and  p  is  an  N-vector 
with 


M  r . . 


Here  the  r^  >_  0  are  integers  describing  the  reactions  and  the  k^  >  0 
are  the  rate  constants.  For  such  problems  we  can  obtain  the  Jacobian 
matrix  f  directly  from  the  relation 


(6.5) 


Most  early  studies  of  Rosenbrock  methods  appeared  in  the  engineering 

literature.  In  particular  we  mention  the  work  of  Calahan,  (1968) , 

Allen  and  Pottle  (1966),  Caillaud  and  Padmanabhan  (1971),  Lapidus  and 

Seinfeld  (1971)  and  Michelson  (1976).  In  Cash  (1976)  the  suggestion 

was  made  to  look  for  Rosenbrock  formulae  with  S  *  0  since  these 

rs 

require  only  one  Jacobian  evaluation  per  step.  Also  given  by  Cash 
was  a  novel  form  of  error  estimation  which  is  applicable  to  a  quite 
wide  class  of  Runge-Kutta  methods.  To  describe  it  we  consider  the 
second  order  Rosenbrock  method 


y 

k 

k 


n+1 
1  * 

2  ’ 


-  yn  =  h(blkl  +  b2k2> 

[I  -  ahJ(yn)]_1f(yn) 

[I  -  ahJ(yn)]_1f(yn  ♦  hc^). 


*' 


» 


m" 


(6.6) 


The  coefficients  of  this  formula  can  be  chosen  so  that  it  is  L-stable 

(Cash  (1976))  and  we  call  the  resulting  formula  R2(xn,u1,u)2,a,c1>h) . 

The  procedure  used  to  obtain  an  estimate  of  the  local  truncation  error 

is  a  modified  form  of  Richardson  extrapolation  whereby  two  approximate 

solutions  are  found  at  each  step  point,  one  using  two  steps  of  size 

h/2  and  the  other  using  one  step  of  length  h.  Thus,  starting  from 

the  point  xn  ^  we  use  the  integration  formulae  R,(xn  ^,<Uj,w2,a,c^,h/2) , 

R,(x  i iu. ,w,,a,c. ,h/2)  to  compute  an  approximate  solution  y  at  x  . 

6  n-j  i  b  i  n  n 

A  second  approximate  solution  y^  is  computed  using  the  formula 
R2^xn  i  ,<*>2 »ci/2 ,h) .  The  crucial  point  to  note  about  using  the 
formula  R2  with  a  steplength  h  is  that  it  uses  exactly  the  same  k^ 
and  k2  as  were  used  by  R2(xn_j,uij  ,a>2,a,c1  ,h/2) .  This  means  that,  in 
general,  a  negligible  extra  computational  effort  is  required  to  com¬ 
pute  the  error  estimate.  In  Cash  (1976)  an  L-stable  formula  of  order 
two  in  two  stages  and  an  L-stable  formula  of  order  three  in  three 
stages  using  a  Merson-type  error  estimate  were  derived.  This  tech¬ 
nique  has  recently  been  used  by  Bui  (1981)  to  obtain  a  fully  embedded 
formula  of  order  3. 

A  modification  of  Roscnbrock  formulae  was  given  by  Wolfbrandt 
(1977).  lie  introduced  the  class  of  ROW  methods  piven  by 


i-1 


i-1 


[I  -  YhJ(y  )]k.  *  hf (y  ♦  Z  a ..k  )  ♦  hJ(y  )  Z  y  k  , 

“  A  11  j*l  J  11  jsl  J 


Vi 


q 

£ 

i«l 


b.k. . 


i  l 


1  i  <_  q,  (6.7a) 


Kaps  and  Warner  (1981)  have  shown  that  mathematically  this  formulation 
is  equivalent  to  the  computationally  more  efficient  class  of  formulae 


where 


i-1  _  i-1 

[I  -  YhJ(y  )]k.  -  hf(y  ♦  Z  i..k.)  ♦  h  Z  ^.k  .  (6.7b) 

n  x  n  j«i  ■>  j*l  J 

We  shall  refer  to  both  these  classes  as  ROW  methods  and  we  note  that 

if  Y- •  ■  Y- •  =  0  they  reduce  to  Rosenbrock  methods.  If  (6.7a)  is 
ij  ij 

applied  with  a  fixed  stepsize  h  to  the  scalar  equation  y'  *  Ay  we 
obtain 


Vl  *  R(z)V  2  *  hA* 


where,  if  the  method  is  of  order  q  at  least. 


R(z)  - 
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j-0 


r  (?) 

i«0  1 
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An  investigation  of  how  to  choose  y  to  give  optimal  stability  and 
accuracy  has  been  carried  out  by  Warner  (1980) .  Higher  order  formulae 
of  the  Rosenbrock,  or  ROW,  class  have  been  derived  by  several  people 
and  in  particular  we  mention  the  work  of  Bui  (1979)  who  derives  an 
L-stable  formula  of  order  4  in  4  stages,  Kaps  and  Wanner  (1981)  who 
derive  methods  of  order  five  and  six  requiring  just  one  Jacobian 
evaluation  per  step  (but  the  step  control  is  by  Richardson  extrapola¬ 
tion^  Kaps  and  Rentrop  (1979)  who  derive  a  fourth  order  method  with  an 
embedded  third  order  method  for  error  estimation,  Ndrsett  and  Wolf- 
brandt  (1979)  who  derive  the  order  relations  for  Rosenbrock  methods 
by  extending  the  Butcher  series  approach,  and  the  thesis  of  Wolfbrandt 
(1977)  which  investigates  ROW  methods.  Finally,  we  mention  a  report 
by  Shampinc  (1980)  who  raises  several  interesting  points  concerning 


the  implementation  of  Rosenbrock  methods.  Generally  speaking, 
Runge-Kutta  formulae  evaluate  the  function  f(x,y)  several  times  in 
the  interval  Ixn*xn+i]*  Shampine  argues  that  it  is  desirable  that 
these  function  evaluations  should  span  lxn>xn4.^l  so  that  the  formula 

Vt  4f 

is  able  to  spot  any  quasi-discontinuities  in  the  solution.  An 
example  of  a  formula  which  docs  not  satisfy  this  condition,  the 
implicit  mid-point  rule,  is  discussed  and  by  considering  a  different¬ 
ial  equation  of  the  form 

y’(t)  »  d  -  by  ♦  aE(t), 

where  the  forcing  function  E(t)  is  a  square  wave,  Shampine  shows  that 
the  implicit  mid-point  rule  can  sometimes  give  a  very  poor  solution 
due  to  its  inability  to  spot  a quasi -discontinuity. 

Another  important  point  raised  by  Shampine  is  that  the  linear 
system  of  algebraic  equations  defining  the  ki  is  almost  bound  to  be 
ill-conditioned.  This  is  also  the  case  for  BDF  methods  but  for  these 
formulae  this  is  not  serious  since  they  solve  for  the  change  in  the 
solution  and  normally  it  is  only  necessary  to  get  the  first  few  digits 
correct.  However,  for  Rosenbrock  methods  this  ill -conditioning  can 
be  serious  and  special  care  must  be  taken  to  monitor  it.  Shampine 
derives  a  fourth  order  formula  with  an  embedded  formula  of  order  three, 
both  of  which  have  rational  coefficients  and  satisfy  the  spanning 
conditions,  and  discusses  their  implementation  and  practical  perfor¬ 
mance  in  some  detail. 

A  class  of  formulae  similar  to  Wolfbrandt's  methods  was  proposed 
by  Cash  (1980).  These  take  the  form 


(6.9a) 


y  ,  -  y  *  E  w.k. 
n*1  n  i-i  1  1 


tl  -  h  v  (yn)]2k.  ■  h(I  .  Ch|£  (yn)>  f(yn  .  Vbjjkj).  (6.9b) 


Each  k^  calls  for  the  solution  of  a  linear  system  of  equations  of 
the  form 

A2k.  =  b. 

l 

This  can  be  done  efficiently,  i.e.  without  the  need  for  matrix  pro¬ 
ducts,  by  LU  decomposing  A  and  solving  the  systems 

LUz  -  b 

LUk.  «  z. 
i 

Cash  gives  an  L-stablc  formula  of  order  3,  with  an  embedded  L-stablc 
formula  of  order  2,  of  the  form  (6.9)  and  the  results  of  some  numeri¬ 
cal  computations  are  reported. 

An  obvious  extension  of  Roscnbrock  methods  is  to  see  what  can 
be  done  with  formulae  of  the  general  form  (6.2)  where  J  is  no  longer 
the  exact  Jacobian.  An  interesting  contribution  in  this  area  is  due 
to  Stcihaug  and  Wolfbrandt  (1979)  who  consider  methods  of  the  form 


i-1  i-1 

(I  -  hd..A)k.  *  f  (y  ♦  h  I  a..k.)  ♦  hA  E  d..k.  1  <  i  <  q.(6.10) 

11  1  n  j«i  J  j.i  ^  J  -  - 


Here  A  is  a  real  square  matrix  and  h  is  chosen  so  that  I-hd^A  is 
non-singular.  Since  A  is  no  longer  the  exact  Jacobian,  there  are 
considerably  more  order  relations  to  be  satisfied  than  for  ordinary 
ROW  methods.  In  particular  Steihaug  and  Wolfbrandt  show  that  to  get 
order  3  it  is  necessary  to  satisfy  eight  order  relations.  They  give  a 


second  order  formula  with  an  embedded  error  estimate  and  present 
the  results  of  some  numerical  computations. 

An  alternative  approach  to  the  problem  of  deriving  Runge-Kutta 
formulae  with  coefficients  depending  on  an  inexact  Jacobian  is  the 
one  due  to  Verwer  (1977).  Verwer  has  investigated  a  class  of  for¬ 
mulae  considered  by  van  der  liouwen  (1972a, b)  and  defines  a  generalised 
m-point  Runge-Kutta  method  to  be 


m-1 


y_ .  i  *  y_  +  E  A  .(h  J  )k 

n+l  n  j kq  m,j  n  n  n 


(j) 


(6.11) 


.m  _ 


j-i 


=  h„f (x„  ♦  u.h  ,  y„  +  £  A.  #(h  J  )k^),  h  =  x  -  x  , 

n  n  n  j  n  'n  •  ^  j,£  n  n  n  "  n  n+1  n 


j-1 

where  *  £  A.  (o) ,  j  -  0,l,...,m-l  and  where  A.  ,  j  »  1,2,. ...m, 

J  ^=o 

£  •  0,1,..., j-1  are  rational  functions  with  real  coefficients.  Verwer 
derives  a  class  of  generalised  Runge-Kutta  formulae  which  have  order 
independent  of  the  choice  of  Jn»  Associated  with  these  formulae, 

Verwer  defines  the  concept  of  internal  S-stability  as  follows. 

Define  y^j  by  the  relation 


hf(xn 

n  n 


+  v .h  , 

J  n' 


yO)  } 

yn+l  J> 


1,2 


,m . 


The  Runge-Kutta  formula  (6.11)  can  then  be  written  as 


Co) 

vi  ■  \ 


■  ■'n  *  X  ‘mV,®,  ♦  -,V  >£!>■  J-1-2 . ■ 

(6.12) 


yn+l  “ 


y0") 

yn*r 


The  usual  approach  in  the  stability  analysis  of  methods  for  stiff 
problems  is  to  examine  the  stability  of  the  solution  only  at  the  end 
point  of  the  current  step.  However,  for  those  Runge-Kutta  schemes 
which  are  such  that  the  solution  is  built  up  successively  in  several 
intermediate  stages  it  is  also  of  interest  to  examine  the  stability 
properties  of  the  intermediate  solutions  y^J  .  To  allow  for  this, 
Verwer  gives  the  following  definition  of  internal  S-stability. 

Definition  8 

The  integration  formula  (6.12)  is  said  to  be  internally  S-stable 
if  at  each  j**1  stage,  j  *  l,2,...,m,  the  corresponding  scheme  at 
stage  j  is  S-stable. 

Verwer  considers  the  performance  of  three  second  order  formulae 
of  the  form  (6.11)  on  a  set  of  three  test  problems.  The  first  for¬ 
mula  is  L-stable  but  not  S-stable,  the  second  is  S-stable  but  not 
internally  S-stable  and  the  third  is  internally  S-stable.  The  numeri¬ 
cal  results  presented  suggest  that  the  third  formula  is  superior  to 
the  other  two  on  the  problems  considered. 

7.  Nonlinear  Methods 

Finally,  we  mention  briefly  an  interesting  class  of  nonlinear 
Runge-Kutta  methods.  It  seems  likely  that  such  methods  will  experience 
difficulties  in  solving  some  classes  of  stiff  systems  but  numerical 
experience  obtained  so  far  indicates  that  they  may  have  real  potential 
in  solving  the  stiff  equations  arising  from  the  methods  of  lines 
solution  of  parabolic  partial  differential  equations.  Their  main 
feature  is  that,  being  nonlinear,  they  arc  able  to  achieve  A-stability 
while  still  being  explicit.  Lambert  (1974)  seems  to  have  been  the 


first  to  consider  nonlinear  Runge-Kutta  methods.  One  particular 
example  he  gives  is 


Vl  -  \  *  hf(Vi>  *  ?  lVi/(V  7  "V1 


(7.1) 


This  method  has  the  advantage  that  it  is  "component  applicable" 

(see  Lambert  (1974),  p.  176)  but  has  the  disadvantage  that,  although 
having  order  2  in  general  it  only  has  order  1  if  y  =  0.  Also,  of 
course,  care  must  be  taken  to  ensure  that  y  -  4  hf  does  not  vanish. 
Nonlinear  Runge-Kutta  methods  were  also  examined  by  Wambecq  (1978) 
and  Hairer  (1980b).  The  general  class  of  formulae  they  consider  is 
given  by 


These  formulae  no  longer  have  a  simple  interpretation  in  component 
form.  Instead,  the  expression  -j-  appearing  in  (7.2)  must  be  inter¬ 
preted  for  real  or  complex  vectors  as 


ab  a  Re(b,d)  ♦  bRe(d,a)  -  dRe(a,b) 
d  *  (d,d) 

where  (a,b)  denotes  the  scalar  product  of  a  and  b.  These  methods  arc 
more  expensive  to  implement  for  systems  than  those  due  to  Lambert 
but  do  not  suffer  from  the  problem  that  the  order  changes  if  y  passes 
through  zero.  However,  there  is  still  the  problem  that  the  denominator 
may  become  zero  as  is  emphasised  by  the  second  order  equation 


h  s  hf(y0> 


g2  *  hf(y0  ♦  j  gj) 
glgl 

X1  "  Xo  *  281“g2  ’ 

so  they  need  to  be  implemented  with  particular  care. 

liairer  (1980b)  gives  a  second  order  AQ-stablc  method  with  an 
embedded  error  control.  In  numerical  tests  this  method  was  found  to 
perform  poorly  on  some  stiff  problems  arising  in  chemical  kinetics 
and  so  they  are  probably  ruled  out  for  the  integration  of  general 
stiff  systems.  However,  good  results  were  obtained  for  the  integra¬ 
tion  of  some  parabolic  P.O.E.s  using  the  method  of  lines.  Because  of 
these  results  and  the  very  low  storage  requirement  of  the  formulae 
(7.2)  (they  do  not  require  the  evaluation  or  storage  of  a  Jacobian), 
they  seem  worthy  of  further  attention  as  candidates  for  use  with  the 
method  of  lines  solution  of  parabolic  partial  differential  equations. 
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SOME  CHARACTERISTICS  OF  ODE  PROBLEMS 


GENERATED  BY  THE  NUMERICAL  METHOD  OF  LINES 


W.  E.  SCHIESSER 
Lehigh  University 
Bethlehem,,  Pa.  USA 


Four-pass  Heat  Exchanger 
(ODE/POE  System) 

d^/dt  - 


Four  tube  fluid  temperatures 
TjCx.t) 

Tj (x,t) 

T3(x,t) 

T4 (x,t) 

Four  metal  temperatures 
T5 (x,t) 

Tg (x,t) 

T?(x,t) 

Tg(X,t) 

Shell  fluid  temperature 
Tg(X,t) 


•  ' 


0  4 


11-point  grid  in  x 
Number  of  OOEs  •  9  x  11  +  1  ■  100 


SUBROUTINE  XNXTAL 


DYNAMIC  MODEL  OF  A  FOUR-PASS  SHELL  AND  TUBE  HEAT  EXCHANGER  KITH 
HAPPING  OF  THE  HOOEL  JACOBIAN  MATRIX 

A  HEAT  EXCHANGER  IS  A  DISTRIBUTED  SYSTEM  IN  MHICH  CONVECTION  AND 
TRANSFER  OF  HEAT  ALONG  THE  EXCHANGER  ARE  THE  PRINCIPAL  MOOES  OF 
OPERATION.  THUS  THE  SPATIAL  DISTRIBUTION  OF  TEMPERATURE  MITHIN 
THE  EXCHANGER  MUST  BE  TAKEN  INTO  ACCOUNT  IN  A  REALISTIC  ANALYSIS. 
IF  THE  TRANSIENT  OPERATION  OF  AN  EXCHANGER  IS  ALSO  TO  BE  CON¬ 
SIDERED.  THE  MATHEMATICAL  HOOEL  MUST  NECESSARILY  INVOLVE  SPACE 
ANO  TINE.  I.E.,  THE  MODEL  IS  EXPRESSED  IN  TERMS  OF  POES.  ALSO. 
NIXING  IN  THE  HEAOERS  OF  THE  EXCHANGER  (THE  ENTRANCE  CHAMBER  FOR 
EACH  TUBE  PASS)  IS  MODELED  BY  OOES  MHICH  SERVE  AS  BOUNOARV  CON¬ 
DITIONS  FOR  THE  POES.  THE  ANALYSIS  OF  EXPERIMENTAL  DATA  FOR  HEAT 
EXCHANGERS  HAS  INDICATED  THAT  THE  MIXING  IN  THE  HEAOERS  CANNOT  BE 
NEGLECTEO  ANO  THUS  A  MIXED  OOE/POE  HOOEL  IS  REQUIRED.  TO  ILLUS¬ 
TRATE  SOME  OF  THESE  CONCEPTS.  CONSIDER  THE  FOLLONlNG  SYSTEM  OF 
NINE  POES  ANO  FIVE  POES  FOR  A  FOUR-PASS.  SHELL  ANO  TUBE  HEAT 
EXCHANGER  (SUBSCRIPTS  T  ANO  X  DENOTE  PARTIAL  DERIVATIVES  MITH 
RESPECT  TO  T  ANO  X.  RESPECTIVELY! 


Tl  »  -C1*T1  ♦  C3MT5  -  Til  (1 

T  X 

T2  «  Cl*T2  ♦  C3MT6  -  T2!  (2 

T  X 

T3  «  -C1*T3  ♦  C3*(T7  -  T3)  (3 

T  X 

TL  •  C1*T4  ♦  C3MTB  -  T4I  (4 

T  X 

T5  ■  C4* ( T 1  -  T5I  ♦  C5MT9  -  T5»  (5 

T 

T6  »  C4MT2  -  T6)  ♦  C5MT9  -  T6I  (6 

T 

T7  »  C4*(T3  -  T7>  ♦  55MT9  -  TTI  (7 

T 

TB  «  C4MT4  -  T8I  ♦  C5*(T9  -  TSI  (S 

T 

T9  ■  -C2*T9  ♦  C6M(T5  -  T9!  ♦  (T6  -  T9I  ♦ 

T  X  (9 

(T7  -  T9»  ♦  (TB  -  T9I I 


THE  NINE  DEPENDENT  VARIABLES.  TKX.TI,  T2(X,TI,  ....  T9U.T)  ARE 
TO  BE  COMPUTED.  Cl.  C2.  ....  C6  ARE  GIVEN  NUMERICAL  CONSTANTS 
MHICH  REFLECT  THE  THERMAL  CAPACITANCES  OF  THE  LIQUIDS  FLOMING 
THROUGH  THE  EXCHANGER*  THE  THERMAL  CAPACITANCE  OF  THE  METAL  IN 
THE  EXCHANGER  TUBES  ANO  THE  HEAT  TRANSFER  CHARACTERISTICS.  EQUA- 


C...  TIONS  (11  TO  (4)  ANO  (91  EACH  REQUIRE  A  BOUNDARY  CONOXTION  IN  X 
C...  ANO  ALL  NINE  EQUATIONS  REQUIRE  AN  INITIAL  CONOXTXON  IN  T.  THESE 
C...  HILL  BE  TAKEN  AS 
C  •  •  • 


c  •  •  • 

OTKO.Tl/QT  a  81*  (TI  - 

Tl(9*T) 1 

(10) 

Ct*B 

c  •  •  • 

OTKO.TI/DT  »  Bl*  (TI  - 

TKO.TII 

(10) 

Cbbb 
c  •  •  • 

Carr 

OT2(L.T)/OT 

■  B2* (TI (L.T) 

-  T2IL.TI) 

(11) 

c«  •  • 

OT3 (0  »T) /DT 

a  B2*  (T2  ( 0 , T I 

-  T3( 0.T) I 

(12) 

Cbbb 

c«  •  • 

OT4(L.TI/OT 

a  B2* (T3 (L.T) 

-  T4(L.T) I 

(131 

Cbbb 

Cbbb 

Cb  B  B 

T9(0«T)  a  TSI 

(1%) 

Cbbb 

Tl(X.O)  «  T2(X.0I  >  T 3 (X. 0) 

*  T4  (  X,  0)  a 

Cbbb 

C  B  B  B 

T5IX.0I  a  T6IX.0)  «  T7(X.O) 

«  T8 (X.O)  a 

(15) 

C«  •  « 

c’m.  T9(X,0I  a  0 

c«  •  • 

C...  FINALLY*  ONE  OROXNARV  DIFFERENTIAL  EQUATION  HILL  BE  AOOEO  TO  NOOEL 
C...  THE  NIXING  IN  THE  HEAOER  AT  THE  EXIT  3F  THE  FOURTH  PASS 

C...  OTO/OT  a  B1*(T4(0,T>  -  TOI  (161 

C*  •  » 

c/..  to (oi  «  o  (in 

c'.'.l  EQUATIONS  (1»  TO  (1TI  CONSTITUTE  THE  COMPLETE  SYSTEM  (NINE  ROES 
C...  ANO  FIVE  ODE SI .  L.  B1  ANO  BE  ARE  THE  EXCHANGER  LENGTH  AND  NIXING 
C...  TINE  CONSTANTS  FOR  THE  HEAOERS.  RESPECTIVELY.  TI  ANO  TSI  ARE  THE 
C...  ENTERING  TEMPERATURES  OF  THE  TUBE  SXOE  AND  SHELL  SIDE  FLUIOS. 

C...  RESPECTIVELY. 

c!!.  THE  SOLUTION  OF  EQUATIONS  (11  TO  (17)  IS  BASEO  ON  THE  APPROXI- 
C...  NATION  OF  THE  DERIVATIVES  IN  X  IN  EQUATIONS  (1)  TO  (4)  ANO  (91 
C...  OVER  A  GRID  OF  11  POINTS.  AN  APPROXIMATING  ODE  IS  HRITTEN  FOR 
C...  EACH  GRXO  POINT  FOR  EACH  POE.  THUS  THERE  HILL  BE  A  TOTAL  OF  11*9 
C...  *  99  OOES  APPROXIMATING  EQUATIONS  (II  TO  (9).  FINALLY.  EQUATION 

C...  (16)  BRINGS  THE  TOTAL  OOES  TO  100. 

C.:.  IN  OROER  TO  GAIN  A  PICTURE  OF  THE  100  OOE  SYSTEM  STRUCTURE.  THE 
C...  FOLLOWING  PROGRAM  ALSO  CALLS  SUBROUTINES  JMAP  ANO  EIGN  TO  MAP  THE 
C...  100  OOE  SYSTEM  JACOBIAN  MATRIX  ANO  COMPUTE  THE  TEMPORAL  EIGEN- 

C...  VALUES.  RESPECTIVELY.  SUBROUTINE  EIGEN  IN  TURN  CALLS  IMSL  ROUTINE 
C...  EIGRF.  IF  EIGRF  IS  NOT  AVAILABLE.  THE  CALL  TO  EIGEN  IN  SUBROUTINE 
C...  PRINT  CAN  BE  CONVERTED  TO  A  COMMENT  (S  IN  COLUMN  II. 

C.  .  . 

C...  THE  USUAL  FUNCTION  OF  SUBROUTINE  XNXTAL.  EVALUATION  OF 
C...  THE  INITIAL  CONOXTXONS  FOR  THE  OEPENOENT  VARIABLES  IN 
C...  COMMON/Y/.  IS  ACCOMPLISHED  BY  A  BLOCK  OATA  ROUTINE. 

C...  THEREFORE  INXTAL  IS  ESSENTIALLY  A  DUMMY  ROUTINE.  ANO 
C...  OOES  NOT  REQUIRE  THE  USUAL  COMMON/T/,  /V/  ANO  /F/. 

C  .  .  . 

RETURN 

ENO 


SUBROUTINE  OERV 
CONHON/T/T IN  E . NSTOP . NORU  N 

1  /Y/  T1  (111  *  TZ  (111  «  TS  (111  ,  T4(ll)  ,  T5<11)  * 

2  T6 (111 •  T7 (11) *  TB(ll),  T9I11),  TO 

3  /F/T1T{11),T2T(11>,T3TI11),T4T(11),T5T111), 

4  T6T:il),T7T:tl),T8Tttll ,T9T(11I ,  T8T 

5  /S/T1X (111 ,T2X  111) »T3X (11) »T4X (11) ,T9X(11) 

6  /C/  NO,  Cl*  C2 .  C3«  C4,  C5* 

7  C6«  31*  82,  TI,  TSI,  XL 

C«*  • 

C««  A 

C..\  SET  BOUNDARY  CONDITION  (14) 

T9(1)«TSI 

C*«  • 

C.::  COMPUTE  THE  FIRST  DERIVATIVES  WITH  RESPECT  TO  X  BY  FIVE»POINT 
C...  CENTERED  DIFFERENCES 

CALL  OSSC04I  0. « XL,NG«T1*T1X) 

CALL  0SS884t  0*  *XL,NG«T2«  T2X) 

CALL  OSS304( 0* »XL»NG«T3*T3X) 

CALL  0SS884( 0. • XL* NG«T4«T4X) 

CALL  OSSOD4I C. « XL,NG,T9«T9X) 

C**  • 

C»!  ASSEMBLE  THE  POES,  EQUATIONS  (1)  TO  (9) 

00  1  1*1 *NG 

T1T«1*-C1*T1X(I)  ♦  C3*(T*II)-T1(I)» 

T2T  (I)*  C1*T2X(I)  ♦  C3MT6(I)-T2U)> 

T3T(I)»-C1*T3X(I)  ♦  C3MT7(l)-T3(I)> 

T4TID*  C1*T4XII)  ♦  C3*(T$(Il-T4(II) 

T5TII)  *  C4MT1(I)-T*tl)) 

l  *  CS*(T9(I)-T9(I>) 

T6TU)*  C4*(T2(I)-T6(I>) 

1  ♦  C»*(T9(I)-T6(I)) 

T7TIII*  C4*(T3(I)-T7II)1 

1  ♦  C5*(T9(I)-T7(I)) 

TOTH)*  C4*(T4:l)-T8(D) 

1  *  C9* (T9  (D-T8  (t> ) 

T9T(I)*-C2*T9X(I)  -  4.*C8*T9CI) 

1  ♦  C6*(T5(I)*T6(I)»T7(I)*Tltt) ) 

1  CONTINUE 
C*  •  * 

c!!!  EVALUATE  THE  OOE  DERIVATIVES  FROM  EQUATIONS  (18)  AND  (13)  AND 
C...  EQUATION  (16).  NOTE  THAT  THESE  DERIVATIVES  MUST  BE  COMPUTEO 
C...  AFTER  THOSE  FOR  THE  POES 
TIT (  1)*81*(  TI-T1(  1)) 

T2 T  (NO *B2*( Tl  (NG) *T2 (N6) I 
T3TI  1)*B2*(T2(  1)-T3(  1)) 

T4TtNCI*82*:T3(N0)-T4(N6)) 

T9T (  1)*0. 

TOT  *B1*(T4(  1)-  TO) 

RETURN 

END 


OOOOUOO<JO<JO<J  ooo  ooo  oooooo 


SUBROUTINE  print  ini, noi 

cohhon/t/tihe,nstop. norun  *# 

1  /V/  Tl(ll)  •  T2  (111  *  ntlll.  Tout),  T5U1), 

2  T6IU1.  T7CU1.  Mltl),  TBI111,  TO 

3  /F/T1T(11I,T2TI111,T3T(11I,TLT(U»,TST<111, 

k  T6T:ill,T7TUll,T0T;il»,TNT<lll.  TOT 

5  /S/T1X  till  »T2X  (lit «T 3X111)  ,TLX(11I  ,T9X(UI 

6  ft/  NC,  Cl.  C2 •  C3.  CL,  C5  , 

7  C6*  31*  82.  TI.  TSI*  XL 

...  •  ' 
...  THIS  SECTION  OF  SUBROUTINE  PRINT 


..  (1)  CALLS  SUBROUTINE  JMAP  TO  HAP  THE  JACOBIAN  HATRIX  OF 

..  100  OOE  SYSTEM. 

•  • 

..  121  CALLS  THE  IMSL  SUBROUTINE  EIGRF  TO  COMPUTE  THE  TEMPORAL 

..  EIGENVALUES  OF  THE  OOE  SYSTEM,  AND  OPTIONALLY.  THE  ASSOCI* 

..  ATEO  EIGENVECTORS. 

..  ABSOLUTE  DIMENSIONING  OF  THE  ARRAYS  REQUIRED  BT  SUBROUTINES  JMAP 
..  (A,  V,  YOLO.  F,  FOLOI  AND  EIGRF  (EIGENV,  MFI 

01  PENSION  AtlOfl.LOQI.  EIGENV 1 1001.  MFtlBOl  , 

1  VI10C),  YOLO (1001 , 

2  FdOOt ,  FOLO(IOO) 

EQUIVALENCE  (Tl(ll,Y(ll},(TlTil),F(lt)  * 

...  THE  COMPLEX  TEMPORAL  EIGENVALUES  OF  THE  OOE  SYSTEM  ARE  STOREO  IN 
..  ARRAY  EIGENV 
COMFLEX  EIGENV 


..  MAP  THE  JACOBIAN  MATRIX  OF  THE  OOE  SYSTEM  DEFINED  IN  SUBROUTINE 
..  OERV,  AND  COMPUTE  ITS  TEMPORAL  EIGENVALUES 
IF (TIME. GT .1 .1  GO  TO  5 

Ns 100  • 

CALL  JHAP( N, A, Y.YOLO.F .FOLOI 

II  SUBROUTINE  EIGEN  (PART  OF  OSS/21  CALLS  IMSL  SUBROUTINE  EIGRF  TO 
..  COMPUTE  THE  TEMPORAL  EIGENVALUES,  AMO  OPTIONALLY  THE  EIGENVECTORS. 

..  OF  THE  100  OCE  SYSTEM  JACOBIAN  MATRIX.  IF  EI3RF  IS  NOT  AVAILABLE, 

..  THE  FOLLOWING  CALL  TO  EIGEN  CAN  BE  CONVERTED  TO  A  COMMENT  (C  IN 
..  COLUMN  11 

CALL  EIGEN  IN, A, EIGENV, HF1  * 


»*oo  *•  f*  ►»  w  on 


...  MINT  A  HC  AO  INC  FOR  THE  NUMERICAL  SOLUTION 
WRITE (NO. 3 1 

FORMAT (INI .  9X  .50HHIXEO  ORO INART/PARTI AL  DIFFERENTIAL  EQUATION  NODE 
1L./I 

WRITE SNO.l) Cl .C2.C3.CA 
FORMAT  I 

13X.4MC1  *  «E 10.3* 3X.4HC2  «  .C10.3.3X.AHC3  •  ,E10.3. 

23X.AHCL  a  .E10.3I 
WRITESM0.2IC5.C6.61.B2 
FORMAT ( 

13X.ANC5  a  .E1Q.3.3X.4HC6  *  .E10.3.3X.4HB1  a  .E10.3. 

23X  .  AMB2  a  .E10.3.//I 
WRITE SNO.A) 

FORMAT ( 

1  6 X, AMTIME .7X.7MT1 (X«8) .7X .8MT*»(X«12I .8X.2HT8.iax. 

2  8HT8 I X»l2 > I 

III  PRINT  THE  SOLUTION 

WRITEIN0.6ITME.T1 11I.TA1N6I  .T0.T9ING1 

FORMAT IE12 .3 . AE1A.SI 

RETURN 

ENO 


OCPCNOCNT  M»!UU  COtUNN  INCEX  J  fFOi  ?J1  IS  N4IN7C0  H09IZONT1U.7 

OCfttVATtVC  *ON  tNQCX  I  1709  07I/0T  *  7I«T1,7* . TJ . VN|  U  7»tNTEO  V(9TICAiiT 

JACOMAM  "9T»tX  CLEMENT  IN  THE  NAN  *ITN  INDICES  I.J  IS  rO»  t/NVJ  «MC»C  7  OC  NOTTS  *  MOVCAl  0t*tV4TXVE 
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99 
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99 

59 

rc 
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72 

73 
7A 
75 
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A9SAA 

A9ASA 

ASASA 

ASASA 

ASASA 

ASASA 

ASASA 

ASASA 

AA9SA 

AS9SS 

SSSSA 
ASSAA 
ASASA 
ASASA 
ASASA 
ASASA 
ASASA 
ASASA 
ASASA 
AASSA 
A  A 
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A 

ASSAA 
ASASA 
ASASA 
ASASA 
ASASA 
ASASA 
ASASA 
ASASA 
AASSA 
A  S3  55 

SSSSA 
ASSAA 
ASASA 
ASASA 
ASASA 
ASASA 
ASASA 
feSASA 
ASASA 
AASSA 
A  A 
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2 
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2 

2 
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2 

2 
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2 

2 

2 


2 


2 

2 


2 


2 

2 


AAAf 
AJA3 
JA3A3 
JASAJ 
SA3A1 
3  A3  AS 
3A3A3 
3aJa) 
SAAAI 
SAAaa 


MIXED  OROINARV/PARTIAL  DIFFERENTIAL  EQUATION  MODEL 

Cl  *  l*98QE+0 0  C2  =  3.0QQE-fli  C3  =  1.30QE-01  C4  *  4.769E-01 
C5  =  4.340E-01  C6  =  9*630E-03  B1  =  5.880E-01  B2  =  2.943E-01 


TIME 

0. 

2.500E+Q0 

5*  oooe+uo 

7.500E+00 

i.oooe+qi 

1.250E+01 
1.500E+Q1 
1.750E+01 
2.000E+01 
2.250E+01 
2.53CE*-01 
2.750E+Q1 
3.  OOOE+Ol 
3.250E+01 
3.5JGE+01 
3*750E»Q1 
4*  0  00E  +  01 
4.250E*0l 
4*  5  00E*Q1 
4*750£»01 
5.<J00E*01 


T1<X=0> 

0. 

7.69564E+QC 
9*  4  6899E+00 
9  «87764E*00 
9.97173E+00 
9. 99344000 
9.99848E+00 
9.99965E+00 
9.99992E*00 
9*99«98E»00 
1.00000E*C1 
l.QOOOOE+Ol 
1 •  00  OOOE+Ol 
l.OOOQOE+Ol 
1.00CCOE»01 
1*0  0  00  0E  +  01 
1.00000E+01 
1.00C00E+C1 
1*00  Q0QE+01 
1.00000E+01 
1*00  OOOE+Ol 


T4<X«12) 

0. 

6.84342E-10 
-2.70340E-07 
4.23113E-Q5 
2.654Q3E-03 
1.402S4E-02 
3.56641E-02 
6.54722E-02 
1.05060E-Q1 
2.56215E-01 
6.38641E-01 
1.20361E+00 
1«  821 86E+00 
2.38733E+00 
2. 85129E+G0 
3.20799E+Q0 
3.47273E*QQ 
3.66745E+00 
3.81257E*0C 
3.92404E+00 
4.01296E*0^ 


TO 

0. 

1.71951E-05 

8.52879E-04 

4.97729E-03 

1.40432E-02 

2.8Q189E-02 

4. 61230E-02 

6*94672  E-02 

1.01372E-Q1 

1.42910E-01 

1.92361E-01 

2.53735E-01 

3.83258E-01 

6.41656E-01 

1  ■  0 1725E  *-00 

1 • 44583E+0Q 

1 • 86Q25E+00 

2.21936E*00 

2.50956E+00 

2.73481E+00 

2.90659E+00 


T9«Xsl2> 

0. 

2.SJ592E-Q7 
-6.12585E-05 
5.12851E-03 
6.31S17E-02 
1.73538E-01 
3.10717E-01 
4,58387E-01 
6*0831 8E-01 
7.58408E-G1 
9.12749E-01 
1.07609E+00 
1.24989E+00 
l*43238£+00 
1.61968E+00 
1.80670E+00 
1*98772E*00 
2.15717E+00 
2*310  66E  *00 
2.44606E+00 
2.56401E+Q0 
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SUBROUTINE  JMAP  NAPS  THE  JACOBIAN  MATRIX  OP  AN  NT H-QROER  SYSTEM  OP 
ALGEBRAIC  EQUATIONS  OR  PIRST-OROER  OROINARY  DIFFERENTIAL  EQUATIONS 
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N  NUMBER  OF  ALGEBRAIC  OR  FIRST-ORDE?  OROINARY  DIFFEREN¬ 

TIAL  EQUATIONS  (ODES!  FOR  WHICH  THE  JACOBIAN  MATRIX  IS 

TO  BE  HAPPEO.  I.E.*  THE  OROER  OF  THE  ALGEBRAIC  OR  ODE 
SYSTEM  (INPUT! 

A  TWO-DIMENSIONAL  ARRAY  CONTAINING  THE  JACOBIAN  MATRIX 

OF  THE  NTH-ORDER  ALGEBRAIC  OR  ODE  SYSTEM  ’.OUTPUT! 

Y  ONE-OINE NSIONAL  ARRAY  OF  N  OE PEN! ENT  VARIABLES  SET  TO 

INITIAL  VALUES  BY  A  CALL  TO  SUBROUTINE  INITAL  IN  JNAP 
t IN*UT  TO  SUBROUTINE  JMAP  VIA  SUBROUTINE  INITAL I 

YOLO  0 NE-0 1 NENS ION AL  WORK  ARRAY  TO  STORE  THE  N  DEPENDENT 

VARIABLES  IN  V  TEMPORARILY  SO  THAT  WHEN  THE  INDIVIDUAL 
Y*S  ARE  PERTURBED  IN  COMPUTING  THE  JACOBIAN  MATRIX  ELE¬ 
MENTS.  THE  Y*S  CAN  THEN  BE  RESTORED  TO  THEIR  ORIGINAL 
VALUES 

F  ONE-DIMENSIONAL  ARRAY  OP  N  DERIVATIVES  OP  THE  DEPENDENT 

VARIABLES  SET  BY  A  CALL  TO  SUBROUTINE  OERV  IN  JMAP 
(INPUT  TO  SUBROUTINE  JNAP  VIA  SU3R3UYINE  OERV! 

POLO  ONE-DIMENSIONAL  WORK  ARRAY  TO  STORE  THE  N  DERIVATIVES 
IN  F  SO  THAT  A  FINITE  DIFFERENCE  APPROXIMATION  OF  THE 
INDIVIDUAL  ELEMENTS  OF  THE  JACOBIAN  MATRIX  CAN  BE  COM¬ 
PUTED 

FROM  THIS  POINT  ON.  THE  DISCUSSION  IS  IN  TERMS  OP  PIRST-OROER 
ODES.  euT  IT  CAN  AS  WELL  BE  PRESENTED  IN  TERMS  OP  LINEAR  OR  NON- 
ALGEBRAIC  EQUATIONS.  OR  TRANSCENDENTAL  EQUATIONS.  OR  a  COMBINA¬ 
TION  OF  ALL  THREE  TYPES  OF  EQUATIONS.  THE  ONLY  REQUIREMENT  IS 
THAT  INITIAL  CONDITIONS  ABOUT  WHICH  THE  JACOBIAN  MATRIX  IS  TO  BE 
COMPUTED  MUST  SE  DEFINED  IN  SUBROUTINE  INITAL.  AND  THE  EQUATIONS 
THEMSELVES  MUST  BE  PROGRAMMED  IN  SUBROUTINE  OERV. 


1 


SUBROUTINES  INITAL  AND  DERV  DEFINING  THF  ODE  STSTEN  ARE  SUPPLIED 
BY  THE  USER*  AS  NELL  AS  A  CALLING  PROGRAM  FOR  JNAP.  THE  MATHE¬ 
MATICAL  CONCEPTS  ARE  EXPLAINED  FURTHER  IN  THE  FOLLOWING  COMMENTS. 
THE  CALCULATION  OF  THE  INDIVIDUAL  ELEMENTS  OF  THE  JACOBIAN  MATRIX 
BY  A  FINITE  DIFFERENCE  APPROXIMATION  IS  PROGRAMMED  AS  STATEMENT  14 
WITHIN  DO  LOOP  T. 


THE  SYSTEM  OF  ODES  FOR  WHICH  THE  JACOBIAN  MATRIX  IS  MAPPED  IS 


OY1/OT  *  FI (Y1 « Y2 i 
0Y2/0T  *  F2tVl»V2i 


OYN/OT  a  FN(Y1|Y2*.*.«YNI 
WHICH  CAN  BE  SUMMARIZED  IN  VECTOR  FORM  AS 


DV/OT  a  Fm 


WHERE 


Y  ■  :V1*V2«..,YN) 


F  a  !Fi,F2....FNI 


SINCE  THE  DERIVATIVE  VECTOR  F  IS  IN  GENERAL  A  NONLINEAR  FUNCTION 

OF  THE  DEPENDENT  VARIABLE  VECTOR  V*  A  TAYLOR  SERIES  EXPANSION 
TRUNCATEO  AFTER  LINEAR  TERMS  GIVES  A  LINEARZEO  APPROXIMATION  OF 
THE  ORIGINAL  SYSTEM 


OV/OT  a  JY 


WHERE  J  IS  THE  JACOBIAN  MATRIX  OF  THE  ORIGINAL  SYSTEM,  I.E., 


F  IS  THE  PARTIAL  DERIVATIVE  OF  F  WITH  RESPECT  TO  Y  .  THUS  THE 
IJ  I  J 

JACC8IAN  MATRIX  IS  SQUARE  (N  X  N). 


» 


3 

S 


h 


c  ••  •  • 

C..1  SUBROUTINE  JMAP  PRINTS  A  TWO-DIMENSIONAL  MAP  OF  J  WITH  THE  NUMBERS 
C...  0  TO  9  INDICATING  THE  RELATIVE  ORDER-OF-MAGNITUOE  OF  THE  INOIVID- 

C...  UAL  ELEMENTS  OF  THE  MATRIX.  THE  VALUES  OF  THE  RON  SUBSCRIPT  I  ARE 
C...  PRINTED  OONN  THE  LEFT  SIOE  OF  THE  MAP  AND  THE  VALUES  OF  THE  COLUMN 
C...  SUBSCRIPT  J  ARE  PRINTED  ACROSS  THE  TOP.  THE  NAP  IS  PRINTED  IN 
C...  SECTIONS  100  COLUMNS  MIOE.  THUS  IF  THE  DIFFERENTIAL  EQUATION 
C...  SYSTEM  IS  GREATER  THAN  lOOTH-OROER,  SUCCESSIVE  SECTIONS  OF  THE  HAP 
C...  HILL  8E  PRINTED  VERTICALLY.  THESE  CAN  THEN  BE  JOINEO  TOGETHER  TO 
C...  MAKE  UP  THE  COMPLETE  MAP. 

^ 

C...  THE  N  X  N  PARTIAL  DERIVATIVES  IN  THE  JACOBIAN  MATRIX  ARE  COMPUTED 
C...  APPROXIMATELY  BY  A  SIMPLE  DIFFERENCING  PROCEDURE.  THE  INITIAL 

c«  •  •  • 

C...  VALUES  OF  Y  REQUIRED  TO  START  THE  CALCULATION  ARE  OBTAINED  BY  A 
C«. .  — 

C...  CALL  TO  SUBROUTINE  INXTAL.  VALUES  OF  F  ARE  COMPUTED  BY  A  SERIES 
C...  OF  CALLS  TO  SUBROUTINE  DERV.  ALTHOUGH  THESE  SUBROUTINE  NAMES 
C...  PERTAIN  SPECIFICALLY  TO  DSV2.  JHAP  CAN  EASILY  BE  ADAPTED  FOR  USE 
C...  WITH  ANY  INITIAL-VALUE  ODE  INTEGRATION  SYSTEM. 

C  .  .  . 

c.. . 


COMMON/IO/  CONTAINS  THE  INPUT/OUTPUT  UNIT  IDEVICEI  NUMBERS 


SUBROUTINE  OEBV 
COHHON/T/TIME,NST OP, NORUN 
1  /Y/  7(1001 

3  /F/  fiiooi 

5  .  /S/T1X (111 « T2X (11)«T3X(11)  *T4X(llt  »T9X 'll ) 

6  /C/  NG,  Cl,  C2 ,  C3 ,  C4,  C5 , 

T  C6,  Bl,  B2«  TI,  TSI.  XL 

COMMON/*/  Tl  (111  ,  T2  (lit  ,  T3(llt,  T4(U)»  TS(11>,  T6(lll, 

1  T7  (111 ,  T8 (lit «  T9 (111 ,  TQ 

COMM0N/8/T  IT  till, T2T Sill ,T3T(11I»T4T till, TSTtlll,  T6T  111)  , 

1  T7T (ll)«T0T(ll)«T9T(il),  TOT 

• 

C... 

C...  TRANSLATE  THE  OEPENOENT  W*RI*BLE  VECTOR  X  IN  COMMON/Y/  TO  THE 
C...  PROBLEM  OEPENOENT  VARIABLES 
J»0 

00  10  I«1,NG 

J*J*1 

TltII«Y(JI 

J*JM 

T2(Il«Y(JI 

J»J*1 

TJIII*Y(JI 

j»j*i 

T4(I|«Y(JI 

TSIlJaYIJl 

J*J»1 

T6(II«Y(J) 

J»J*1 

T7(II»VCJ1 

J*JM 

TOC  I)sY(J) 

J»J*1 
T9( II«Y(JI 
10  CONTINUE 
J*J*1 
TO*Y(JI 

c««  • 

C...  SET  ROUNOARV  CONOITION  (141 
T9(1I«TSI 

C,,  , 

C..f  COMPUTE  THE  FIRST  DERIVATIVES  NITH  RESPECT  TO  X  BY  FIVE-POINT 

c...  centered  differences 

CALL  OSS004(0.,XL,NG,T1,T1XI 
CALL  0SSQQ4( Q,,XL,NG,T2,T2XI 
CALL  OSS004(0.,XL.NG,T3,T3X) 

CALL  DSSG04I  0,«XL,NG«T4,  T4X1 
CALL  OSSOO 4 ( 0 « ,XL ,NG, T9 ,T9X) 


on  h  nnnn  oooor* 


C...  ASSEMBLE  THE  POES, 
DO  1  1*1, NG 
T1TCI)*-C1»T1XCI>  ♦ 
T2TCI)*  C1*T2X (I)  * 
T3TU)*-C1*T3XCI)  ♦ 
T4TCI)*  CI*T4XII)  * 
T5TCD* 

1  ♦ 

T6T  tl) * 

1  ♦ 

T7T.II)* 

1  ♦ 

TST  SI)* 

1  * 

T9TtI>*-C2*T9XCI>  - 

1  ♦ 

CONTINUE 


EQUATIONS  tl)  TO  t9> 

C3*<T5Ct)-TltI)) 

C3MT6II1-T2CI)) 

C3*tT7tI)-T3tH) 

C3MT8CI)-T4tI)l 

C4*CT1U)-T5CI)) 

C5MT9CII-T5  CU» 
C4*tT2tI)-T6tI>) 
C5*(T9CI)-T6CI)) 
C4MT3CI1-T7CI)) 
C5*CT9<I)-T?tI)) 
C4*tT4fI)-TBtII) 
C5*(T9CI)-T8CI)) 

4.*C6*T9CU 

C6*(T5 CI)*T6CI)*T7(I)*T8CI>> 


♦ 


...  EVALUATE  THE  ODE  DERIVATIVES  FROM  EQUATIONS  (10)  AND  (13)  ANC 
...  EQUATION  1161.  NOTE  THAT  THESE  DERIVATIVES  MUST  3E  COMPUTED 
...  AFTER  THOSE  FOR  THE  POES 

T1T1  l)*Bl*t  TI-Tlt  II) 

T2T  (NG)*82* (Tl (NG) -T2ING)  1 
TTTC  1)*B2*(T2(  D-T3I  1)1 
T4T(NG)*82*(T3(NG)-T4(NG)) 

T9T:  l)*fl. 

TOT  »B1*(T4(  D-  TO) 


TRANSLATE  THE  PROBLEM  OEPENOENT  VARIABLE  DERIVATIVES  TO  THE 
OEPENOENT  VARIABLE  DERIVATIVE  VECTOR  F  IN  COHHON/F/ 

4*0 

00  U  1*1, NG 
4*4*1 

F(4)*T1T  Cl) 

J*  J*1 

F ( J)  =  T2T  1 1 ) 

4=4*1 

FI J)«T3T«I) 

4=4-*l 

F(4)*T4T(I) 

4*4*1 

Ft4)*T5TtI) 

4*4*1 

F  C4)*T6T (I I 
4*4*1 

FC4)*T7T:I) 

J*4*l 

FC4)*T8T<I> 

4*4*1 

Ft4)*T9TtI1 

CONTINUE 

4*4*1 

F(4)*T0T 


RETURN 

END 
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93 

A 

AA 

9A 

3 

A  22223 

A 

3 

99 

A 

9 

A  A 

9 

A 

9# 

A 

9 

A  A 

9 

A 

97 

A 

9 

A  A 
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00 

A  A 
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A 

02 

A 

AA 

03 
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A  22223 
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A  A 
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A 

00 

A 
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NIXEO  OR  DIN  ARY/PARTIAL  DIFFERENTIAL  EQUATION  MOOEl 


Cl  =  1.980E4-00 

C2  a  3.0 00E— 0 1 

C3  = 

1.300E-01 

C4 

a  4.769E-01 

CS  a  4.340E-01 

C6  *  9.630E-03 

B1  a 

5.880E-01 

32 

*  2.943E-01 

TINE 

TlIXaCI 

T4 1 X=12) 

TO 

T9(  X*12) 

0. 

0. 

0. 

0. 

0. 

Z.500E+00 

7.70630E»00 

6.60325E-1C 

1.63208F-05 

2.B9873E-07 

5 •  0  0  0E  +  00 

9.47145E+00 

-2.52796E-07 

8.46567E-04 

-5.90177E-05 

7.5  JCE+CO 

9.8782CE+00 

3.956G4E-35 

4.96740E-03 

5.0106 4E- 03 

1.000E+01 

9.97186E*00 

2.63610E-03 

1.40335E-02 

6.30533E-02 

1.2S0E+01 

9. 99357E+00 

1.39411E-02 

2.79863E-02 

1.73425E-01 

1.530E+01 

9.99851E+Q0 

3.55964E-02 

4.60878E-02 

3.10620E-01 

1.75CE+01 

9.99965£*&Q 

6.54438E-32 

6.94014E-C2 

4.5B362E-01 

2.030E+01 

9. 99992E*00 

1.04453E-01 

1.01294E-01 

6. 0  83 1 3E-01 

2.250E+01 

9.99998E«-00 

2.54327E-01 

1.42843E-01 

7.58368E-01 

2.50GE+Q1 

1. OQOOOE^Ol 

6.36993E-01 

1.92319E-01 

9.12573E-01 

2.750E+Q1 

1.00000E*01 

1.29306E+C0 

2.53294E-S1 

1.37601E*03 

3*  OOOE+Ol 

1.00  000E+  01 

1.8ZZ26E*00 

3.82244E-01 

1.249S3E +00 

3.250E+01 

1.0  0  0Q0E+01 

2 .38  814E+00 

6.40658E-01 

1.43235E+Q0 

3.590E+01 

1.00000E»01 

2.85217E*QQ 

1.01675E+00 

1.&1969E»0Q 

3.750E+01 

1.00  000E+  01 

3.20  876E*00 

1  •44590E*'  00 

1.8)674E«-03 

4.3  jGE*Q1 

1.3CCOCE*01 

3 .4733  DE+QO 

1.86068E*Q0 

1.9B780E  *00 

4.250E+01 

1.00000E+01 

3.66781E+00 

2 .21990E*  00 

2.15728E+00 

4.50QE+01 

1.00  00  OE*  01 

3.81278E*00 

2 .5 1Q09E+G 0 

2.3107 9E ♦00 

4.75QE+31 

1 . 0  0Q00E+  01 

3. 92419E+00 

2.73525E+00 

2.44619E+00 

5.3  3QE+01 

1.3  0  300E+01 

4.013  07E*  30 

2.9J692EHJ3 

2.56412E+00 

uuuo  -•  ooo 


SUBROUTINE  DERV 
COMNON/T/TIME,NSTOP, NORUN 

i  nt  moot 

3  /F/  F t 1001 

5  /S/T1X (lll«T2X(lll»T3X(lll »T4X (11) ,T9X ( 111 

6  /C/  NG*  Cl*  C2«  C3«  C4»  C5» 

7  C6.  81*  82 »  TX»  TSI,  XL 

COMMON/*/  T1 (lit «  T2 (111 *  T3 ( 111 »  T4(lll ♦  T5I11I*  T6I11I* 

1  T7tll>*  mil).  TBtlll.  TO 

COMHON/8/T1T (111 «  T2T (111  *  T3T ( 111 *T4T (111 *T5T  (111 ,T6T  (111 . 
1  T7T(111,T8T(111.T9T(11>,  TOT 


...  TRANSLATE  THE  OEPENCENT  VARIABLE  VECTOR  X  IN  COHHON/Y/  TO  THE 
...  PROBLEM  OEPENOSNT  VARIABLES 
4*0 

00  10  I*1*NG 
4*4*1 
Tl(Il*Y(41 
4*4*1 
T5(II«Y(4l 
4*4*1 
T2 (I 1*Y( J1 
4*4*1 
T6(II»T(JI 
4*4*1 
T9(11*V(4I 
4*J*1 
T3(I1*Y(JI 
4*4*1 
T7(II*Y(4l 
4*4*1 
T4(X)*V(4I 
4*4*1 
T8(XI*T(4I 
0  CONT  ZNUE 

4*4*1 
T0*V(J! 

<#  m  •*•••*#***••**•*•••*•*****••****••*•••*•»•••••**•••••**••**•* 

SET  BO UNO ARY  CONOXTXON  (141 
T9(1!*TSI 

c  •  •  • 

C**I  COMPUTE  THE  FIRST  DERIVATIVES  KITH  RESPECT  TO  X  BY  FIVE-POINT 

C...  CENTERED  DIFFERENCES 

CALL  OSS004(0.*XL«MG«T1,T1XI 
CALL  OSS004( 0**XL«NG«T2f T2XI 
■  CALL  OSS0Q4(0.,XL*NG*T3*T3X) 

CALL  OSS004 ( 0. »XL*NG»T4*  T4X1 
CALL  OSSOa»(0.«XL*NG«T9*T9XI 


OO  *40000  oooo 


...  ASSEMBLE  THE  POES*  EQUATIONS  ill  TO  (91 
00  1  1*1. NG 
TlT(Il*-Cl*TlX(II 
T2TII1*  C1*T2X(I1 
T3TII1*-CI*T3X(XI 
TLT  ( II «  Cl* TLX (I) 

T5T (X) * 

1 

T6T (XI  * 

1 

T7TIII * 

1 

TJTIII ■ 

1 

T9T ( II *-C2*T9X (XI 

1 

CONTINUE 

...  EVALUATE  THE  OOE  DERIVATIVES  FROM  EQUATIONS  (101  ANO  (131  ANO 
...  EQUATION  (161.  NOTE  THAT  THESE  DERIVATIVES  MUST  BE  COMPUTED 
...  AFTER  THOSE  FOR  THE  POES 
-  TIT (  llaBlM  TX-Tll  111 
T2T (NG1*82* (T1(NGI-T2(NGII 
T3T(  1I*B2*(T2(  11-T3I  111 
T4T  (NG1*82*  (T3  (NCI  -TMNGI  I 
T9T (  11*0. 

TOT  *B1* (TL(  11-  T01 

... 

...  TRANSLATE  THE  PROBLEM  OEPENOENT  VARIABLE  DERIVATIVES  TO  THE 
...  OEPENOENT  VARIABLE  DERIVATIVE  VECTOR  F  IN  COMNON/F/ 

J*0 

00  11  I*1*NG 
J*J*1 

F(  Jl  aTlTdl 
J*J*1 

F(J|>TST(II 
J*J*1 

F(J1«T2T(I1 
J*J*t 

FIJI *T6T(II 
J*J*1 

F  ( J )  «T9T  ( II 
J*J*1 

F(j|*T3T(XI 
J«J»1 

F(Jl«TTT(Il 
J*J*1 

F(J1«TAT(I1 
J»J*1 

F(J|«TAT(I1 
11  CONTINUE 
J«J*1 
F( JI»T0T 


♦  C3*(TS(II-T11I1I 

♦  C3* (T61II-T2 (III 

♦  C3*(T7II1  -T3 (III 

♦  C3*(TSIXI-Tt(XII 
CL*IT11II-TSII1I 

♦  C5MT91X1-TS (III 
CL*(T2(II-T6  (III 

♦  C5* (T9(I I -T6 (III 
CL*IT3(I1-T7II1I 

♦  C5*(T9(Il-T7 (III 
Cl* (TL(Xi-TS(i)i 

♦  CS*(T9(I) -TO (III 
-  L.*C6*T9(I) 

♦  C6*(T5(X!+T6(X)*T7  .‘•l+TBdll 


C  .  .  . 

c  •  •  . 
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-.411 

71 

-.411 
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•1 

-.11* 
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-.411 
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4* 

-.414 

1* 

-.41* 
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4* 
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-.411 
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-.111 
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11 

-.414 

1* 
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19 

-.414 

1* 

-.114 

17 

-.414 

1* 
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•MM 

1.7** 

•t>2M 

t.ru 
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1.717 

-1.717 
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•i.m 
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MM 
•1.1M 
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•MU 
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.737 
—  737 
•  717 
-.717 
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Mil 
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1.111 
MM 
Mm 
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1.171 
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•  339 
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HIXEO  OROINARY/PARTIAL  DIFFERENTIAL  EQUATION  HOOEL 


Cl  =  1 • 980E+  0  0  C2  =  3. 

000E-01  C3  = 

1. 300E-01  C4 

=  4.760E-01 

C5  a  4.340E-Q1  C6  =  9. 

630E-03  31  = 

5.880E-01  32 

a  2.940E-01 

TIME 

TKXsOI 

T4(X»121 

TO 

T9CX®12) 

0. 

0. 

0. 

0  • 

0. 

2.500E+00 

7 . 70630E+00 

6.60325E-10 

1.63208E-05 

2.89873E-07 

5.000E+00 

9.47145E+00 

-2.52796E-07 

3*  46567E-04  ■ 

-5.90177E-05 

7.500E+00 

9.87820E+00 

3.95604E-05 

4.96740E-03 

5.01064E-03 

1. 000E*-01 

9.97186E+00 

2. 63610E-03 

1.40335E-02 

6.30533E-02 

1.250E+01 

9.99357E+00 

1 .39411E-02 

2.79863E-02 

1.73425E-01 

1*  50  0E  +  01 

9.99351E+00 

3.55964E-02 

4.60373E-02 

3.10620E-01 

1.750E*Q1 

9.99965E+00 

6.54438E-02 

6.94014E-02 

4.58362E-01 

2»  OOOE  +  Ol 

9 • 99992E+00 

1.04453E-01 

1 • 01294E- 01 

6.08313E-01 

2.250E*01 

9.99998E+00 

2.54327E-01 

1.42843E-01 

7.58368E-01 

2«  5  00E+01 

i.OOOOOE+Ql 

6.36993E-Q1 

1.92319E-01 

9.12673E-01 

2.750E»Q1 

l.OOQCOE+Ol 

1 • 203G6E+  0  0 

2.53294E-01 

1.07601E+00 

3.000E+01 

1*  0  00  00E+01 

1. 82226E+00 

3*  822  44E-01 

1.24983E+00 

3.250E+01 

1. OOOCOE+Ol 

2.38814E+0C 

6.40658E-01 

1.43235E+0Q 

3.500E*01 

1. 00000 £+01 

2 •  85217E+0  0 

1 • Q1675E+  00 

1. 61969E+00 

3.750E*>01 

1.  0000QE+01 

3  «  20876E  +  0  0 

1.4459QE+00 

1*  80674E+00 

4. 000 Ef 01 

1 • 0  0  OOOE+Ol 

3.47330E+00 

1. 86068E+0Q 

1*  98780E+00 

4.250E»01 

1.00000E+01 

3 • 66781E+00 

2. 21990E+00 

2.15728E+Q0 

4.500E+01 

1*  QQ000E+01 

3.81278E+00 

2« 51009E+0Q 

2.31079E+00 

4.750E*01 

1.00000E+01 

3.92419E+00 

2.73525E+00 

2. 44619E+ 00 

5 • 0  0  0  £  +  01 

1.  00000E+01 

4.01307E+00 

2 • 90692E+ 00 

2. 56412E+00 

A  MAP  OF  THE  JACOBIAN  MATRIX  INDICATES: 

(1)  THE  ODE  SYSTEM  OVERALL  STRUCTURE 
(BANDEDNESS,  SPARSENESS,  ETC.) 

(2)  ORDER  OF  MAGNITUDE  OF  THE  MATRIX 
ELEMENTS 

(3)  THE  DETAILED  RELATIONSHIPS  BETWEEN 
DEPENDENT  VARIABLES  AND  DERIVATIVES 

(4)  THE  DEGREE  OF  NONLINEARITY  AS  REFLECTED 
BY  CHANGES  IN  THE  MATRIX 


THE  TABULATION  OF  THE  ODE  SYSTEM  EIGENVALUES 
INDICATES: 

Cl)  STABILITY 

(2)  TIME  SCALE 

(3)  STIFFNESS 

(A)  CONTRIBUTIONS  OF  INDIVIDUAL  ODES 
(5)  PARAMETER  SENSITIVITIES 
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THE  NUMERICAL  METHOD  OF  LINES 
FOR  ODE/PDE  SYSTEMS 

uT  =  F(x^T>0>0y^  ^xxx' ’ ‘ ^ 

g(xb,t,u,u*,Gr^...)  =  0 

U(X,TO)  a  UO(X) 

Number  of  PDEs  *  M 

(u(X,T)  IS  AN  M  VECTOR) 

G(lAX,T),  I  s0,  1,  2m.„  N 

Number  of  ODEs  =  MN& 

D  -  1,  2,  3 

Gt(iax,t),  i*0,  L  2„nJ 


Burger's  Equation 


u.  »  uu  -  uu 

t  XX  “x 

u(x,0)  -  4>  (x r  0 ) 

u(0,t)  »  <fr  (0,t) 
u(l,t)  * 


<ji(x,t)  ■ 


0«l€  A  +  0.5e  ®  +  e-^* 


e”A  + 


-B  -C 
e  +  e  u 


A  *  (0.05/u) (x  -  0.5  +  4 . 95t) 
B  *  (0.25/y) (x  -  0.5  +  0.75t) 
C  *  (0.5/y) (x  -  0.375) 
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SoluCion  of  Stiff  Equations  Resulting  from 
Partial  Differential  Equations 


Bruce  A.  Finlayson 
Department  of  Chemical  Engineering 
University  of  Washington 
Seattle,  Wash.  98195 


Engineers  often  need  to  solve  mathematical  models  that  are 
expressed  as  partial  differential  equations.  This  paper  des¬ 
cribes  several  case  studies  from  the  author's  experience,  empha¬ 
sizing  the  methods  chosen  to  integrate  the  equations  in  the  time 
domain,  with  special  regard  for  the  constraints  prescribed  by  the 
fact  that  the  time-dependent  ordinary  differential  equations  are 
derived  from  partial  differential  equations  in  space  and  time. 

There  are  four  themes  illustrated  in  the  case  studies: 

1.  When  a  partial  differential  equation  is  discretized  in 
the  spatial  domain  by  using  a  finite  difference,  finite 
element,  or  global  collocation  method,  the  resulting 
equations  in  time  are  stiff.  The  degree  of  stiffness 
can  often  be  estimated  £  priori. 

2.  Integration  schemes  that  work  well  for  large  error 
tolerances  are  valuable.  First,  the  spatial  truncation 
error  may  be  large  and  it  is  wasteful  to  make  the  tempo¬ 
ral  truncation  error  very  small.  Secondly  ,  the  solu¬ 
tion  may  have  the  same  properties  throughout  the  time 
interval  considered;  that  is,  the  type  of  solution 
which  causes  the  problem  to  be  very  stiff  in  the  first 
place  may  move  as  a  wave  through  space,  so  that  as  time 
proceeds  the  only  thing  that  changes  is  the  location  of 
the  stiffness-producing  feature,  not  the  stiffness  it¬ 
self.  In  that  circumstance,  methods  which  rely  on  tak¬ 
ing  large  time  steps  during  part  of  the  time  interval  to 
achieve  their  success  may  be  less  useful. 

3.  Schemes  and  packages  must  be  applicable  to  combined  or¬ 
dinary  differential  equations  and  algebraic  equations, 
since  these  often  occur  in  practice.  The  time  deriva¬ 
tive  must  be  allowed  to  enter  the  problem  as  a  matrix 
multipied  by  the  vector  of  time  derivatives,  since  that 
form  arises  in  most  Galerkin  finite  element  methods. 

4.  For  large  time-dependent  problems  in  two  and  three  spa¬ 
tial  dimensions,  extensive  codes  have  already  been  de¬ 
veloped  using  schemes  that  may  not  be  the  best  for  stiff 
problems.  The  techniques  developed  for  stiff  problems, 
though,  must  be  done  in  a  way  that  the  schemes  can  be 
easily  fit  into  those  codes. 
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The  themes  are  illustrated  in  case  studies.  The  first  study 
is  for  chemical  reactors  in  the  form  of  packed  beds.  While  ki¬ 
netic  behavior  has  traditionally  been  stiff,  the  packed  bed  reac¬ 
tor  can  become  more  stiff  due  to  sharp  changes  in  temperature. 
Such  reactors  provide  a  useful  and  demanding  testing  ground  for 
stiff  integrators.  The  second  case  study  is  for  flow  through  po¬ 
rous  media.  Here  the  problem  is  extremely  stiff  and  good  numeri¬ 
cal  solutions  are  difficult  to  obtain  under  certain  conditions. 
The  spatial  variation  of  the  solution  plays  a  role  both  in  defin¬ 
ing  the  stiffness  and  in  limiting  certain  advantages  of  s.tiff  in¬ 
tegration  codes.  The  final  example  is  the  convective  diffusion 
equation.  This  equation  has  similar  difficulties  to  the  equation 
for  flow  through  porous  media,  but  is  linear.  Even  so,  in 
two-dimensional  time-dependent  simulations  the  most  sophisticated 
techniques  are  required. 


Chemical  Reactors 

A  prototype  model  of  a  packed  bed  reactor  is  given  by  the 
following  equations. 


£c.  m  *  c)__  A 
dt  S  r  dr  V.  dr, 

)+/?  R(c.T) 

<*t_  (V£L 

r  dr  '  dr 

)+/?'«( s-n 

O 

il 

1* 

OIL 

J  *3 

af  r  -o 

cn 

c  =  c.  ,  T--  Tc 

o.¥  -L  ~  o 

<k  2>T  . 

IT  ‘°  >  "  ' 

■■  &,,(T-rO  J-r.-l 

(4) 

The  physical  meaning  of  the  dimensionless  coefficients  is  given 
elsewhere  £lj.  One  method  for  solving  these  equations  is  to  use 
the  finite  difference  method  to  represent  the  spatial  variation 
of  the  solution  and  then  use  some  other  method  of  solution  in 
time,  such  as  Runge-Kutta,  trapezoid  rule  (giving  the 
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Crank-Nicolson  method),  or  a  GEAR  package.  If  we  divide  the  dis¬ 
tance  O^rdl  by  a  uniformly  space  set  of  grid  points,  with  spacing 
h,  we  can  write 

TJ(t)  *  T(rj,t)  ;  r  -  fc(j-i) 


The  differential  equation  (2)  then  becomes  (for  an  internal  point 
not  on  the  boundary): 

§  -  + A ft* -  w* M) 

CfZ  *»  4 

This  equation  can  then  be  written  as 

gw'IB^T  ^'R(c.>Tj)  (,) 

where  the  matrix  B. .  is  derived  from  Eq.  (6).  The  task  is  then 
to  integrate  the  Jset  of  ordinary  differential  equations,  as  an 
initial  value  problem. 

Another  method  of  solution  is  to  represent  ;:he  spatial  vari¬ 
ation  of  the  solution  with  a  polynomial  defined  over  the  entire 
domain,  0£r£l.  Collocation  is  applied  at  the  Gaussian  quadrature 
points,  giving  the  orthogonal  collocation  method  £l,2j.  The  re¬ 
sult  of  applying  this  method  to  Eq.  (2)  has  the  same  form  as  Eq. 
(7),  except  that  the  matrix  B..  is  different.  In  particular  it 
is  dense  (every  entry  is  non-zero)  instead  of  banded. 

If  a  Galerkin  finite  element  method  is  applied  to  Eq.  (2) 
the  result  is  slightly  different.  ( 


Notice  here  that  the  left-hand  side  involves  a  matrix  multiplica¬ 
tion.  This  means  that  explicit  schemes  for  integrating  Eq.  (8) 
are  ruled  out,  or  must  at  least  involve  one  LU  decomposition  of 
the  matrix  C...  Furthermore  some  packages  for  integrating  ordi¬ 
nary  differential  equations  do  not  allow  equations  in  such  a 
form,  or  require  extra  manipulation.  For  example,  the  code 
LSODI,  developed  by  Hindmarsh  at  the  Lawrence  Livermore  Labora- 
tor,  can  be  applied  to  equations  in  this  form,  whereas  the  GEAR 
or  GEARB  packages  developed  by  Hindmarsh  must  be  applied  to  the 
revised  equation, 


PAGE  4 


where  Che  notation  C  is  meant  to  denote  an  LU  decomposition 

rather  than  an  inversion,  to  preserve  the  sparse  nature  of  the 

matrices  B..  and  C... 

iJ  iJ 

All  methods  lead  to  sets  of  ordinary  differential  equations 
that  must  be  integrated  in  time.  The  various  packages  RKF45, 
GEAR,  GEARB,  LSODE,  LSODI  can  all  be  applied  to  some  subset  of 
the  problems.  The  finite  difference  method  and  the  finite  ele¬ 
ment  method  lead  to  problems  with  banded  matrics,  whereas  the  or¬ 
thogonal  collocation  method  leads  to  problems  with  dense  ma¬ 
trices.  Despite  this  difference  it  turns  out  that  all  the  meth¬ 
ods  lead  to  stiff  equations  if  very  many  grid  points  are  used. 
This  point  is  illustrated  with  the  diffusion  equation. 

For  a  diffusion  problem 

-  £1 
ax1 


we  can  apply  finite  difference,  finite  element  or  orthogonal  col¬ 
location  methods  to  obtain  a  discretized  set  of  equations. 


rcu  f  -  *  6at; 


(\0\ 


The  difficulty  of  integration  of  these  equations  depends  on  the 
eigenvalues  of  the  matrix,  in  particular: 


def  Cy<\  "Bj-|  =  O 


For  collocation  and  finite  difference  methods  the  matrix  C..  is 
the  identity  matrix.  If  we  apply  separation  of  variables  fcii  Eq. 
(9)  we  are  led  to  the  eigenvalue  problem. 

d  k 

If  we  apply  collocation,  finite  difference,  or  finite  element 
methods  to  this  eigenvalue  problem  we  get  Eq.  (11).  Thus  the 
first  eigenvalue  from  Eq.  (11)  represents  an  approximation  (and 
usually  a  quite  good  approximation)  to  the  first  eigenvalue  of 
the  physical  problem,  Eq.  (12).  The  largest  eigenvalue, 
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however,  is  found  to  be  represented  by  the  following  equation, 

where  the  value  of  LB  is  listed  in  Table  I  for  a  variety  of  meth¬ 
ods  LlJ.  What  this  means  is  that  the  stiffness  ratio  for  a  line¬ 
ar  diffusion  problem  is  given  by 

SR  =  LB/X.U1  6V| 

and  that  as  h  becomes  smaller,  when  we  add  more  grid  points,  the 
problem  becomes  stiffer.  These  features  are  magnified  for  the 
nonlinear  problem,  such  as  Eq.  (1,2). 


Table  I.  Values  of  LB  in  Eq.  (13) 


Method  LB 

Finite  difference  4 

Collocation,  FEM 

cubic  functions  36 

quartic  functions  98 

quintic  functions  222 

Collocation,  Hermite 

cubic  functions  36 

Galerkin,  FEM 

linear  12 

quadratic  60 

Galerkin,  FEM,  lumped 

linear  4 

quadratic  24 


The  implication  of  this  informatin  is  that  if  the  problem 
demands  a  large  number  of  finite  difference  grid  points  or  finite 
elements  to  represent  the  spatial  changes  in  the  solution,  then 
the  temporal  problems  are  guaranteed  to  be  stiff,  and  integration 
methods  must  be  used  that  are  applicable  to  stiff  equations. 

The  solution  methods  described  above  are  embodied  in  two 
computer  codes,  REACOL  for  orthogonal  collocation,  and  REACFD  for 
finite  difference.  The  temporal  integration  is  done  by  one  of 
three  methods:  a  fixed-time-step  second-order  Runge-Kutta  meth¬ 
od,  a  variable  time-step  fourth-order  Runge-Kutta  method,  and  the 
GEARB  package  (Hindmarsh  version).*  The  program  is  arranged  so 
*GEARB  is  used  for  orthogonal  collocation  only  because  it 
was  available,  even  though  the  appropriate  package  is  GEAR. 
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that  Che  user  can  easily  change  Che  resccion  race  expression  and 
Che  number  of  componencs  Co  fic  Che  siCuaCion.  The  advancage  Co 
using  such  a  code  in  an  academic  seCCing  is  chac  every  sCudenc 
can  obCain  resulcs  for  his  or  her  reaccor  model  even  Chough  Che 
problem  may  be  very  difficulC.  IC  is  very  discouraging  (and  noC 
Coo  conducive  Co  learning)  Co  Cry  Co  solve  a  difficulC  problem  , 
gee  unstable  numerical  results,  and  noC  know  where  Che  difficulty 
lies  -  in  Che  coding  or  Che  problem.  Use  of  GEARB  obviates  Chat 
uncertainty;  if  GEARB  has  difficulty  Che  student  may  scill  want 
Co  look  aC  Che  coding  for  possible  errors,  but  half  Che  beetle  is 
won. 


|  As  a  simple  example  take  Eq.  (1,2)  with 

R»  (T) 

and  the  parameters  V  «  ef*-  1,  [$ •  0.3,  ,t  '  ■  0.2,  •  20,  Biw 

I  *  20,  Tw  ■  1,  Cq  *  Tq  ■  1.  Solutions  obtained  with  the  orthogo- 

nal  collocation  method  are  shown  in  Table  II.  Mote  particularly 
chac  if  only  two  collocation  points  are  used  in  Che  radial  direc¬ 
tion  (a  number  which  suffices  for  some  problems)  all  Che  temporal 
methods  Cake  about  Che  same  computation  time  and  have  comparable 
1  errors.  The  error  is  almost  entirely  due  to  the  spatial  approxi- 

1  maCion,  as  can  be  seen  by  comparing  the  resulcs  for  N  *  2  and  N  ■ 

5.  For  N  ■  5,  however,  Che  problem  is  stiffer,  and  Che  methods 
designed  for  stiff  equations  are  faster,  although  not  any  more 
accurate.  When  the  finite  difference  method  is  employed  with  a 
fixed  Cime  step  and  a  second-order  Runge-Kutta  method,  the  solu- 
|  cion  varies  wich  grid  spacing  and  cime  step. 

a.  4-  4>  (is*} 

There  is  no  need  to  take  t  very  small  to  have  an  accurate  answer 
in  time  when  there  is  scill  some  CruncCion  error  in  space.  In 
face  because  of  Che  cancellation  of  errors  in  Eq.  (15)  this 
method  may  be  more  accurate  chan  a  solution  derived  using  a  vari¬ 
able  time-step  Runge-Kutta  method  or  GEAR  method. 


Table  II.  Solutions  to  Reaction  Problem 
Giving  values  of  average  concentration  at  one  t  ■  0.6. 


N  in 

orthogonal 

collocation 

c 

Method  in  time 

CPU  time 
sec 

2 

0.806S 

RK-2 ,  t  ■  0.005 

0.97 

0.8031 

RKINIT,  eps  -  10-5 

0.97 

0.8088 

GEARB,  eps  ■  10-5 

1.00 

5 

0.9197 

RK-2,  t  ■  0.001 

14.1 
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1 


'  • 

0.9198  RKINIT,  eps  *  10-5  7.9  — 

0.9206  GEARB,  eps  »  10-5  3.1 

exact  0.91926 


A  phthalic  anhydride  reactor  provides  a  real,  case  with  in¬ 
teresting  mathematical  results  (3,4).  This  time  the  packed  bed 
reactor  is  operated  under  conditions  in  which  the  temperature  of 
the  packing  need  not  be  the  same  as  the  temperature  of  the  fluid 
flowing  past  the  packing.  This  temperature  difference  occurs  be¬ 
cause  reaction  occurs  on  the  catalytic  packing  and  energy  is 
given  off,  raising  its  temperature.  The  energy  must  be  trans¬ 
ferred  to  the  fluid,  but  encounters  a  heat  transfer  resistance 
between  the  packing  and  the  fluid.  The  resulting  equations  are 
similar  to  Eq.  (1-4),  except  that  there  are  several  species  to 
consider. 


<5c;  .  .<  3/ 
d*  ~  r 

r  £i\ 
dr  ) 

ar. 

(r£) 

tv(T,-T) 

(17) 

9 

bt  r  <>r 

V  dr  1 

y(Ts-T)  : 

(l8) 

9 

The  function  R  is  a  nonlinear  function  of  concentration  and  pack¬ 
ing  temperature,  T  .  Thus  Eq.  (18)  represents  an  algebraic 

equation  to  be  solved  at  each  position  r  and  t.  When  orthogonal  • 

collocation  is  applied  to  Eq.  (16-17)  one  obtains  a  set  of  ordi- 

nary  differential  equations,  as  in  Eq.  (6),  coupled  with  a  set 

of  algebraic  equations.  This  type  of  problem  can  be  solved  using 

REACOL  and  GEARB  provided  the  reaction  rate  expression  solves  the 

algebraic  equation  for  Tg  given  the  fluid  temperature  and  all  the 

concentrations.  This  was  done  using  Newton-Raphson  to  solve  the  • 

nonlinear  equations.  At  the  conference,  results  also  will  be 
presented  using  the  program  LSODI. 

This  reactor  is  parametrically  sensitive.  Figure  1  shows 
the  solution  when  the  inlet  and  wall  cooling  temperature  are  620 

K  and  630  K.  In  the  first  case,  the  conversion  of  ortho-xylene  v 

to  phthalic  anhydride  is  well  behaved  and  the  temperature  of  the 

reactor  remains  within  bounds.  If  the  temperature  is  raised  just 

10  K,  though,  the  temperature  rises  very  sharply,  and  all  the 

phthalic  anhydride  is  further  reacted  to  form  carbon  dioxide. 
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The  GEARB  package  is  capable  of  performing  Che  integration  up 
until  che  point  where  the  reaction  temperature  rises  precipi- 
tiously;  there  the  integration  stops  because  it  cannot  proceed 
with  a  very  small  required  step  size.  This  is  a  good  example  of 
the  power  of  having  a  robust  stiff  integrator  available.  When  a 
robust  integrator  is  used  and  che  reactor  "blows  up"  we  know  that 
something  dramatic  is  happening  in  the  physics  and  chemistry,  be¬ 
cause  otherwise  che  integrator  would  handle  the  problem  easily. 
This  same  feature  of  reliability  ms  especially  valuable  in  a  pi¬ 
oneering  study  of  che  kraft  pulping  process.  £0*  1°  this  case 

reaction  and  diffusion  occured  in  a  wood  chip,  and  the  equations 
are  similar  to  Eq.  (1-4).  The  reaction  rate  expressions  are  un¬ 
usual,  however,  and  lead  to  some  difficult  integration  problems. 
The  REACOL  program  with  orthogonal  collocation  and  GEARB  per¬ 
formed  admirably  and  gave  valuable  results  that  otherwise  might 
have  been  clouded  by  numerical  problems  and  uncertainties. 

Flow  Through  Porous  Media 

The  next  case  study  concerns  the  movement  of  water  through 
very  dry  soil.  The  equation  is 


with  boundary  conditions  appropriate  to  injecting  liquid  water  at 
one  end  by  keeping  the  pressure  or  saturation  at  a  fixed  value, 

p(  o,t\  =  6P( 

~  C)  K  ~  I 

The  initial  conditions  are 

p(x,0)  SPO 


When  the  soil  is  very  dry,  the  relative  permeability,  kf,  can  j 

vary  over  many  orders  of  magnitude;  factors  of  10°  are  not  un¬ 
common.  The  derivative  of  a  saturation  with  capillary  pressure 

can  also  make  large  variations.  For  the  cases  considered  here  we  »  “ 

Cake  these  functions  as  ^  - 

lCr-  i  s*o.«4o.ta/6+p<LA’'V 
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Typical  solutions  sre  shown  in  Figure  2  as  a  function  of  the  ini¬ 
tial  dryness;  as  can  be  seen,  if  the  soil  is  initially  very  dry 
the  profile  is  very  steep  and  the  water  front  moves  through  the 
porous  media  as  a  wave. 

It  is  clear  that  to  interpolate  such  a  function  it  is  neces¬ 
sary  to  have  a  very  fine  mesh  near  the  front.  Unfortunately,  the 
fron  moves  in  time,  so  that  the  fine  mesh  must  either  be  every¬ 
where  or  else  it  oust  somehow  be  moved  to  occur  in  the  right  lo¬ 
cation  at  the  right  time.  A  straightforward  application  of  the 
finite  difference  method  to  Eq.  (19)  gives 


One  method  of  evaluating  the  permeability  is  to  take  an  average 
value. 


(mK-.,') 


These  equations  can  be  integrated  using  a  package  for  stiff  equa¬ 
tions,  such  as  GEARB.  At  any  time  one  can  stop  the  integration 
and  determine  the  eigenvalues  of  the  Jacobian  of  Eq.  (20). 
Typical  values  are  listed  in  Table  III.  Notice  that  some  of  the 
stiffness  ratios  are  quite  large,  10  . 


Table  III.  Eigenvalues  of  Jacobian,  L  ■  100 


BPO 

BP  1 

max  EV 

min  EV 

SR 

CR 

0 

-2 

1.2E6 

0.25 

4.9E6 

1.4E5 

-0.5 

-2 

1.3E3 

0.22 

5.6E3 

1.4E2 

0.05 

-3 

1.5E8 

0.14 

1.1E9 

1.3E8 

-0.5 

-3 

1.2E3 

0.032 

3.9E4 

1.2E3 

0 

-5 

7.5E3 

0.0053 

1.4E7 

3.0E5 

We 

can  also 

define  a  coefficient  ratio  as 

follows 

f  1 

CK 

Y 

t 

t 

L  dS 

1 

i 

kr  d  ft 

1  • 

4 

This  ratio  can  be  calculated  a  priori  since  it  depends  only  on 
the  pressure,  and  the  range  of  pressure  values  is  known  at  the 


outset.  Fortunately,  it  correlates  very  well  with  Che  calculated 
stiffness  ratio,  as  indicated  in  Figure  3.  This  coefficient 
ratio  Chan  provides  a  guide  for  other  problems  to  help  identify 
which  problems  are  going  to  be  especially  stiff.  It  is  also  use¬ 
ful  for  choosing  a  useable  time-step  for  a  fixed  time-step  meth¬ 
od.  Jensen  and  Finlayson  6  show. how  optimal  discretization  can 
reduce  the  stiffness  ratio  from  101  to  10°  for  one  of  these 
problems. 

One  of  the  difficulties  with  this  problem  is  that  the  pres¬ 
sure  can  be  positive  if  the  soil  is  saturated.  Under  those  con¬ 
ditions  the  coefficient,  dS/dp  *  0.  If  the  soil  is  initially 
dry,  and  then  one  end  is  putcin  contact  with  water  (say  a  layer 
of  water  is  place  on  cop  of  it)  then  that  end  will  be  saturated. 
The  saturated  region  will  move  in  time.  The  region  of  space 
which  is  saturated  then  is  governed  by  an  equation  like  (19)  but 
with  no  time  derivative,  i.e.  an  algebraic  constraint.  Thus  to 
solve  this  problem  it  is  necessary  to  have  a  stiff  integration 
package  which  can  handle  these  algebraic  constraints,  and  the 
number  of  algebraic  constraints  depends  on  the  solution  and  may 
change  in  time.  A  modification  of  the  original  Gear  program 
was  made  in  order  to  do  this. 

Supposing  the  time  dependent  nature  of  the  solution  is  prop¬ 
erly  handled,  what  type  of  behavior  usually  results?  One  solu¬ 
tion  is  shown  in  Figure  4;  it  was  generated  using  the  Galerkin 
method  with  some  upstream  dispersion  and  a  trapezoid  rule  in  time 
with  a  fixed  time-step.  The  solution  is  clearly  in  error. 
Unfortunately,  the  errors  are  not  caused  by  the  time  step  used; 
solving  the  problem  more  accurately  in  time  leads  to  no  better 
solution.  The  difficulty  lies  with  the  spatial  approximation. 
In  this  case  only  20  elements  were  used  and  it  is  clear  that  the 
type  of  solution  expected  cannot  be  interpolated  with  20  ele¬ 
ments.  For  another  problem  discussed  below  it  is  possible  to 
show  how  many  elements  are  needed  for  a  given  solution.  Here  we 
cannot  do  Chat,  but  other  calculations  indicate  something  like 
200  elements  are  needed  if  a  cubic  trial  function  is  used,  giving 
601  total  points.  Sometimes  it  is  not  possible  to  compute  with 
this  many  points  for  economic  reasons.  In  Chat  case  one  might 
try  to  use  only  20  or  40  elements.  If  one  does  so  with  a  stiff 
integration  package,  the  oscillations  caused  by  the  poor  spatial 
approximation  will  be  carefully  followed  by  the  integration  pack¬ 
age,  and  large  time  steps  will  never  be  achieved.  In  such  cases, 
then,  it  does  not  make  sense  to  use  a  small  error  tolerance, 
since  the  spatial  contribution  to  the  error  is  large  anyway,  ex¬ 
cept  that  the  integration  packages  may  not  work  except  with_^mall 
values.  The  author  has  found  that  values  of  eps  below  10  are 
generally  necessary  for  the  GEARB  package  developed  by  Hindmarsh 
to  work  efficiently  for  these  problems. 

If  one  is  dissatisfied  with  a  solution  containing  oscilla¬ 
tions,  since  the  oscillations  are  known  to  be  due  to  numerical 
errors,  and  the  calculations  must  be  performed  on  a  fixed  budget, 


it  is  necessary  to  resort  to  introducing  numerical  dispersion. 
In  this  problem  the  simpliest  way  to  do  so  is  to  evaluate  the 
permeability  by  using  the  valuue  of  permeability  at  the  nearest 
node  upstream  (with  upstream  defined  as  the  direction  with  the 
largest  pressure). 


There  are  other  more  sophisticated  and  more  accurate  methods  as 
well.  If  one  does  this  then  the  oscillations  are  damped;  the 
front  is  smooth  but  may  be  much  smoother  than  the  true  solution. 
When  this  approach  is  taken  it  clearly  does  not  make  sense  to 
solve  the  equations  in  time  very  accurately;  the  spatial  contri¬ 
bution  to  the  error  is  large.  Again  stiff  integration  packages 
that  work  well  with  large  error  tolerances  are  important. 

Figure  5  shows  the  error  in  the  pressure  at  a  particular  po¬ 
sition  and  time  (chosen  so  that  the  sharp  front  is  nearby  and  any 
errors  in  the  position  of  the  front  cause  a  large  error).  The 
finite  difference  method  is  used  in  space  and  two  methods  are 
used  in  time.  One  uses  a  backward  Euler  method  with  a  fixed  time 
step.  As  the  time  step  is  decreased  the  error  decreases,  but  ap¬ 
proaches  an  asymptote  since  eventually  all  the  error  is  contained 
in  the  spatial  approximation.  A  modified  version  of  Gear  is  also 
used  (modified  to  allow  algebraic  equations)  and  the  problem  is 
solved  with  error  tolerances  of  eps  ■  1.0  and  0.1.  With  these 
values  the  solution  is  solved  accurately  in  the  sense  that  there 
is  very  little  time  truncation  error,  but  the  economic  cost  is 
high  since  the  computation  time  is  more  than  that  obtained  with  a 
simple  fixed  time-step  method.  Part  of  the  reason  the  stiff  in¬ 
tegration  package  did  no  better  than  this  is  that  the  problem  is 
stiff  because  the  pressure  changes  from  the  boundary  value  to  the 
initial  value,  and  this  leads  to  large  variations  in  the  coeffi¬ 
cients.  Yet  the  solution  always  makes  this  variation,  and  is  al¬ 
ways  this  3tiff,  and  large  time  steps  are  not  utilized  in  any 
portion  of  the  time  integration.  Furthermore,  small  oscillations 
that  appear  initially  (and  are  inevitable  when  there  is  a  step 
change  in  the  boundary  condition  at  time  zero)  are  carefully 
tracked  by  the  stiff  integration  package.  This  example  is  not 
meant  to  be  presented  as  a  failure  of  the  stiff  integration  pack¬ 
age  -  indeed  the  package  made  possible  many  solutions  that  were 
otherwise  inaccessible  -  but  to  indicate  that  the  dramatic  re¬ 
sults  achieved  in  other  contexts  do  not  always  obtain  for  solving 
the  ordinary  differential  equations  derived  from  partial  differ¬ 
ential  equations. 

If  one  wants  to  solve  this  problem  really  well  it  is  neces¬ 
sary  to  either  use  a  very  fine  mesh  or  a  moving  mesh.  This  was 
done  by  one  of  the  author's  students  [6^.  The  problem  was  trans¬ 
formed  to  a  moving  coordinate  system  that  moved  with  the  velocity 
of  the  front.  Then  the  front  stayed  in  the  same  position  for  all 
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tine,  and  Che  location  of  Che  boundaries  moved  in  time.  The  so¬ 
lution  required  defining  a  set  of  nodes  and  solving  the  problem 
on  a  subset  of  nodes,  and  the  subset  kept  changing  in  time. 
Rather  than  trying  to  force  such  a  problem  into  the  structure  of 
the  existing  stiff  integration  packages  (such  as  GEARB)  it  was 
easier  to  use  the  trapezoid  rule,  with  a  fixed  time-step.  Since 
the  solution  hardly  changed  in  time,  large  time  steps  could  be 
used;  indeed  the  major  time-saving  resulting  from  the  technique 
was  the  large  time  steps  possible;  in  Che  moving  coordinate  sys¬ 
tem  the  solution  appeared  as  if  it  was  in  steady  state.  While  a 
stiff  integration  package  was  not  used  in  the  solution,  the  ex¬ 
perience  of  using  them  on  similar  problems  and  understanding  why 
they  did  not  always  work  well  was  an  essential  preliminary  to 
devising  such  a  strategy. 


Chemical  Flooding 

One  of  the  methods  for  producing  oil  from  existing  oil 
fields  is  to  inject  a  solution  of  surfactant  chemicals  in  water 
in  order  to  reduce  the  interfacial  tension  between  the  water  and 
oil  phases.  A  prototype  problem  related  to  this  problem  is  the 
solution  of  the  convective  diffusion  equation. 


at  r  re  a* 

cOsot  -o 

*  I 

cO  >M*0 


A  numerical  solution  is  shown  in  figure  6.  This  solution  was  ob¬ 
tained  using  the  finite  difference  equation  in  the  form 


dt  ^ 


The  ordinary  differential  eqquations  were  than  solved  using 
GEARB.  The  error  criterion  was  set  low  enough  that  the  solutions 
are  essentially  the  exact  solutions  of  the  difference  equations 
(21).  If  only  50  grid  points  are  used,  oscillations  develop,  as 
shown.  These  oscillations  are  inherent  in  the  spatial  approxima¬ 
tion  -  no  better  solution  of  the  ordinary  differential  equations 
is  possible.  The  GEARB  routine  faithfully  follows  the  develop¬ 
ment  and  propagation  of  each  oscillation.  If  500  grid  points  are 
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used,  then  the  numerical  solution  is  essentially  exact,  as  shown. 
Here,  too,  the  time  dependent  equations  are  solved  essentially 
exactly. 


Now  consider  the  problem  when  the  parameter  Pe,  the  Peclet 
number,  increases  by  1000  times.  Then  we  need  500,000  points  for 
a  good  solution,  and  such  a  solution  is  very  expensive  to  obtain. 
Yet  if  fewer  points  are  used,  oscillations  develop  due  to  the 
spatial  approximation,  and  very  accurate  time-dependent  methods 
are  not  helpful.  In  this  case  we  can  introduce  upstream  disper¬ 
sion  by  changing  the  convection  term  to  the  following  form. 


*  c«  - e 

<9*  l  .  Ax 

V 


Figure  6  shows  the  solution  using  this  form  when  only  50  grid  po¬ 
ints  are  used.  The  solution  is  smooth,  the  solution  to  the 
time-dependent  equations  is  found  very  accurately  by  the  GEARB 
routine,  but  it  is  clear  that  the  error  obtained  when  comparing 
the  numerical  solution  to  the  exact  solution  is  large.  Again  it 
makes  little  sense  to  obtain  very  accurate  answers  to  a  problem 
when  upstream  dispersion  has  been  introduced;  a  stiff  integrator 
is  needed  that  works  well  for  large  values  of  the  error  control 
parameter . 


This  problem,  too,  can  be  solved  by  a  moving  coordinate  sys¬ 
tem,  and  this  has  been  done  by  Jensen  and  Finlayson  £6j.  Very 
small  meshes  are  used  near  the  front,  and  the  front  is  stationary 
in  the  moving  coordinate  system,  but  the  location  of  the  boundar¬ 
ies  changes  in  time.  In  order  to  achieve  economical  results  it 
is  necessary  to  use  a  method  of  integration  which  is  at  least 
A-s table,  and  the  trapezoid  rule  was  used.  Large  time  steps  were 
then  possible.  Because  some  of  the  nodes  are  in  the  solution  do¬ 
main  and  others  are  not  at  any  particular  time  the  stiff  integra¬ 
tion  packages  were  not  used. 


For  the  chemical  flooding  application  it  is  necessary  to 
solve  equations  like  the  convective  diffusion  equation  in  a  two 
dimensional  region. 


dt 


4  u  +  V 
<3  X 


iS 


Typically  fluid  is  injected  in  one  corner  of  a  square  and  removed 
in  the  corner  diagonally  opposite.  The  Peclet  number  is  very 
large,  requiring  a  small  grid  spacing  to  prevent  oscillations. 
The  small  grid  spacing  makes  the  calculations  very  expensive,  and 
numerical  dispersion  cannot  be  used  because  it  changes  the  peak 
concentration  of  the  surfactant  in  an  unrealistic  way,  which 
changes  the  phenomenon.  One  solution  to  this  problem  is  to  solve 
the  equations  on  a  moving  coordinate  system,  this  time  one  that 
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moves  from  Che  injection  well  Co  Che  production  well.  Small  fin- 
ice  elements  are  placed  near  Che  front,  and  the  front  always 
stays  in  the  region  where  the  elements  are  small.  To  efficiently 
handle  the  time-dependent  problem,  though,  it  is  necessary  to  use 
an  integration  method  that  is  A-stable,  so  that  large  time  steps 
can  be  taken,  but  also  one  Chat  is  efficient  in  solving  the  line¬ 
ar  algebra  problem  which  must  be  solved  each  time  step.  Solving 
these  equations  with  a  banded  solver  is  much  less  efficient  than 
solving  with  a  profile  or  frontal  routine.  Thus  it  was  necessary 
to  develop  a  method  which  was  compatible  with  a  frontal  routine, 
was  A-stable,  and  had  an  automatic  step  control  feature.  In  es- 
sense,  what  was  needed  was  a  low-order,  high-eps  version  of 
GEARB . 


Since  a  graded  mesh  was  involved  it  was  most  convenient  to 
use  the  Galerkin  finite  element  method  since  elements  of  differ¬ 
ent  sizes  are  easily  handled.  This  means  that  the  differential 
equation  (22)  is  in  an  implicit  form. 


+  c; 


c. 
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Gresho,  Lee  and  Sani  £8]  of  the  Lawrence  Livermore  Laboratory 
have  provided  an  integration  routine  that  has  the  features  of 
stiff  integration  packages.  It  uses  a  second-order 
Adams-Bashforth  method  for  a  predictor,  a  trapezoid  rule  for  the 
corrector,  and  the  difference  between  the  predicted  and  corrected 
value  to  control  the  step  size  to  meet  the  specified  error  toler¬ 
ance.  Gresho,  et  al.  provided  both  a  first  and  second  order 
method,  as  we  do  here.  The  method  used  by  Gresho,  et  al., 
though,  is  based  on  time  derivatives  of  the  variables.  Since  "the 
equation  is  implicit,  it  is  necessary  to  solve  this  implicit 
equation  first  even  to  get  started.  Rather  than  doing  that  we 
devised  a  method  based  upon  extrapolation.  The  derivation  is 
given  here  for  the  first  order  method,  and  the  results  for  the 
second-order  method  are  in  the  Appendix. 

First  we  write  an  equation  for  an  extrapolation  of  the  poly¬ 
nomial  going  through  the  solution  at  t  .  .  _  , 

*  °  n-1  and  t  (see  Figure  7). 

The  method  is  illustrated  for  dy/dt  ■  f(y).  n 

C  •  *.  +r 

*  -» 


We  next  write  a  Taylor  series  for  the  exact  solution,  assuming 
the  exact  solution  is  known  at  the  beginning  of  a  time  step, 

t 


y(tn) 


y  and 
n 


’n-1’ 


y(tn-l} 
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Subtracting  this  from  Eq.  (23)  gives 

U«)  -L  (4„)  /z. 

Using  a  Taylor  series  for  yn_^ 

^ 

gives 


The  corrector  is  given  by  the  backward  Euler  method. 

j.\.  +  (»*) 

The  truncation  error  of  the  backward  Euler  method  is 

7*+t  "3^"^  *  ^  3"  /*"  (iV) 

The  values  of  y^  and  yC  .  are  available  from  Ire 
'  n+1  1  n+1  t 

(23,25).  We  solve  Eq.  (24,26)  for  the  unknown  y(t  .)  and 
y"n(  ^).  The  result  is  n 

iL-tf*  1  - 

Thus  the  truncation  error  is  then  estimated  using 

c.  p 

2  4-  A„ 

To  summarize  we  use  Eq.  (23)  to  predict  y  +  Eq.  (25)  to  cor¬ 
rect,  and  Eq.  (27)  to  estimate  the  truncation  error. 

The  estimate  of  the  truncation  error  is  used  to  pick  the 
next  time  step. 


f 
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where  *  is  the  user-specified  accuracy.  In  Jensen's  thesis  C.9J 
this  time  step  was  used  for  the  next  calculation.  Jensen  also 
used  the  second  order  version  for  the  convective  diffusion  equa¬ 
tion. 

In  practice,  of  course,  the  estimate  of  truncation  error  may 
not  be  a  good  estimate,  and  after  picking  a  time  step  and  doing 
the  calculations  the  estimate  of  the  truncation  error  in  the  new 
step  may  be  larger  than  5  .  Consequently,  Jensen  QoJ  devised 
the  following  strategy  to  allow  recalculation  when  necessary. 
Define  the  error  for  sets  of  equations  as 

/  .  *  ,  \  '4 


d  - 


£.  <  d. 


the  timestep  is  not  accepted  since  the  truncation  error  estimate 
actually  achieved  is  greater  than  expected  from  the  previous 
steps.  The  step  is  repeated  with  a  step  size  half  as  big.  The 
value  of  beta  is  empirically  chosen  in  the  range  1  to  1.5.  If 

1  i/ft, 


then  the  step  is  accepted.  However,  if 

6.  ^  d*  £ 


the  next  timestep  is  decreased  according  to 

k 'I. 

rw-i  "  n. 


This  allows  the  estimated  error  to  be  slightly  larger  than  de¬ 
sired,  as  large  as  beta  x  epsilon.  If 
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Che  next  timestep  is  kept  Che  same,  and  alpha  is  a  paramecer  em¬ 
pirically  chosen  in  Che  range  1  Co  10.  Finally  if 


a  $ 


Q_ 

oL 


Che  Cime  seep  is  increased  according  eo 

4, 


wich  a  maximum  raCio  of  3  Co  prevenC  inCroducing  excessive  error. 
The  corresponding  formulas  based  on  inCerpolacion  using  second 
order  expressions  are  given  in  Che  Appendix. 

The  time-step  scheme  described  above  is  based  on  Che  same 
ideas  concained  in  Che  GEARB  package  developed  by  Hindmarsh,  buC 
has  Che  advanCage  Chac  ic  is  easily  implemenCed  in  a  code  ChaC 
already  uses  Che  backward  Euler  meChod.  The  second-order  scheme 
in  Che  Appendix  can  likewise  be  used  in  a  code  ChaC  now  uses  Che 
Crapezoid  rule,  or  Crank-Nicolson.  The  second  order  scheme  was 
applied  by  Jensen  in  his  Chesis  Co  solve  for  Che  movemenC  of 
chemical  in  che  cwo-dimensional  flow  paccern  described  above.  He 
always  accepCed  che  predicCed  sCep  size,  and  always  accepCed  Che 
soluCion,  even  if  che  CruncaCion  error  Curned  ouC  Co  be  Coo 
large.  When  che  soluCion  reached  a  poinC  in  which  smaller  Cime 
sCeps  had  Co  be  Caken  ic  sometimes  broke  down.  LaCer  he  devised 
Che  sCraCegy  given  above  for  accepCing  a  sCepsize,  and  applied 
Chis  Co  a  large  code  for  sCeam  injecCion  of  an  oil  field,  where 
ic  worked  wich  good  resulCs  |.10j.  Approximately  30  to  50Z  of  the 
computation  Cime  was  saved  compared  to  Che  previous  sCep-size 
conCrol  strategy,  and  cases  converged  Chat  had  not  converged  with 
Che  previous  sCategy.  The  previous  sCraCegy  was  one  in  which  Che 
change  in  saCuracion  or  pressure  from  one  Cime  step  Co  another 
was  kept  below  a  prescribed  value.  Obviously  this  limits  Che 
truncation  error  only  in  some  vague,  general  sense.  The  schemes 
discussed  here,  however,  have  a  theoretical  justif icaCion  and 
work  even  better. 


Conclusion 

The  concepts  of  stiff  inCegracion  codes  can  somecimes  be  ap¬ 
plied  direcCly  Co  solve 'Che  ordinary  differencial  equations  aris¬ 
ing  from  partial  differencial  equations.  In  some  cases,  however, 
Che  problems  are  so  difficult  or  large  chac  a  straightforward  ap¬ 
plication  of  Che  stiff  integrators  would  be  prohibitive  in  cost. 
In  such  cases  che  principles  of  che  sciff  integrators  can  some¬ 
cimes  be  incorporCaCed  with  ocher  solution  techniques  and  cricks, 
leading  Co  a  viable  solution  method.  These  principles  have  been 
illuscraced  in  three  case  sCudies. 
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Appendix 

The  formulas  analogous  to  Eq.  (23-27),  but  for  a 
second-order  trapezoid  rule  are: 

*■  *1  fn., 

--  I  +  ^  f  |  +■  7 

*1  ^  ^*.-1  +  A*-l  ■* 

*  =  k  A- +«>...  t 

t'-i  A.-* +*•„.,) 


0  ;  u  +  fll 

r*+  •  *  a. 

c,  *  1  /it 


[4 


for  several  solutions  to  Eq.  (20) 


profile  by  Gslerkin  method. 


1  10  100  1000 

CPU  sec 

Figure  5.  Error  in  pressure  solution.  Finite  Difference 
Geer  0 


*•  Solution  of  Convective  Diffusion  Equation. 
Finite  Difference,  centered,  n  ■  50,500. 

Finite  Difference,  upstream,  n  ■  50. 
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Introduction 

Professor  Aiken  asked  me  to  present  an  overview  of  stiffness  as 
encountered  in  the  field  of  heat  transfer.  My  primary  objective  will 

be  to  draw  your  attention  to  current  problems  of  physical  reality  and  * 

importance  in  chat  field.  I  have  chosen  to  interpret  his  invitation 
to  include  energy  changes  from  one  form  to  another,  thus  encompassing 

shock,  deflagration,  and  detonation  waves.  Before  considering  stiff-  • 

ness  I  will  digress  to  review  the  relationships  between  heat  transfer, 
mass  transfer,  momentum  transfer  and  chemical  kinetics. 

Analogies  and  Couplings  of  Heat  Transfer  with  Mass  Transfer,  V 

Momentum  Transfer  and  Chemical  Reactions 


Mass  Transfer. 

The  transfer  of  chemical  species  bears  a  close  analogy  to  heat  • 

transfer,  although  usually  further  complicated  by  multicomponents  and 
sometimes  by  the  self-generaticr.  of  a  net  flow  normal  to  the  surface, 

the  so-called  Ackermanr.  effect  [see,  for  example,  Grober,  Erk  and  • 

Jri-'ull  (1561)  p.  4.' If,  and  Bird,  Stewart  and  Lightfoot  (1560)  p.  €?6f ;  . 


Also,  the  geometries  of  greatest  interest  in  mass  transfer  are  not  in  General 
the  same  as  in  heat  transfer.  For  example,  convective  heat  transfer  usually 
occurs  from  one  confined  fluid  stream  to  another  through  a  thin  solid  wall. 


whereas  mass  transfer  characteristically  occurs  from  one  fluid  to  another  in 
direct  contact  or  to  a  solid  surface.  Mass  transfer  often  occurs  simultaneous¬ 
ly  with  and  coupled  to  heat  transfer  whereas  heat  transfer  generally  occurs  in 
the  absence  of  mass  transfer.  Heat  transfer  with  phase  changes  (boiling, 
condensation,  melting  and  solidification)  is  more  important  than  the  analogous 
processes  of  mass  transfer.  Cn  the  other  hand  the  transfer  of  species  due  to 
an  electric  potential  does  not  have  an  important  analog  in  heat  transfer. 

Heat  transfer  by  radiation  has  a  superficial  analogy  with  the  transport  of 
thermal  neutrons  (see,  for  example,  Chu  and  Churchill  (1956)]  as  well  as  with 
other  electromagnetic  radiative  processes  [see,  for  example,  Kerker  (1963)]. 
Momentum  Transfer 

The  current  of  momentum  (ordinarily  equal  to  the  shear  stress)  is  a 
tensor  of  second  order  as  compared  witn  the  currents  of  energy  and  scecies 
which  are  vectors  (tensors  or  first  order) .  Hence  an  analogy  between 
momentum  transfer  and  heat  (or  mass)  transfer  is  somewhat  artificial  and 


can  only  occur  ir.  degenerate  cases. 


Ever,  so,  this  concept,  as  first 


conceived  by  Reynolds  and  improved  by  Prandti  and  others  [see,  for  example, 
IrOLer  et  al.  1*961;  p.  242f,  395fj ,  ;.as  proven  to  be  invaluable  fcr  tur¬ 


bulent  transport.  The  predict 


predictions  based  on  this  analogy,  despite  its 


snaky  foundation,  are  prccabiy  mere-  reliable  tear,  the  available  experimental 
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data  [see,  for  example,  Churchill  (1977)].  Since  it  is  uncertain  whether 
or  not  a.  priori  solutions  of  turbulent  transport  will  ever  be  achieved, 
this  useful  analogy  should  not  be  scorned  for  its  obvious  empiricism. 

Momentum  and  convective  heat  transfer  usually  have  at  least  a  one-way 
coupling,  i.e.,  the  rate  of  heat  transfer  depends  critically  upon  the  velo- 

I 

city  field.  Conversely,  momentum  transfer  depends  on  heat  transfer  only 
insofar  as  the  viscosity  and  density  vary  with  temperature.  In  free  (un¬ 
confined)  and  natural  (confined)  convection  owing  to  a  density  variation 
and  a  gravity  field,  the  equations  for  heat  and  momentum  trams fer  are 
strongly  intercoupled  and  must  be  solved  interactively.  Some  free  or  na¬ 
tural  convection  always  accompanies  forced  convection,  its  relative  impor¬ 
tance  depending  on  the  ratio  of  the  maximum  density  difference  to  the  square 
of  the  imposed  velocity  [see,  for  example,  Churchill  (1982a,  1982b)]. 
Momentum  and  Maas  Iransfer 

To  return  to  mass  transfer,  gravitationally  induced  changes  may  also 
occur,  leading  to  analogous  couplings  between  momentum  and  mass  transfer, 
and  to  triple  couplings.  The  latter  is  an  important  but  relatively  un¬ 
studied  problem  [see,  for  example,  Seville  and  Churchill  (1970)].  Coupled 
mass  and  momentum  transfer  may  also  occur  due  to  the  interfacial  tension 
between  two  immiscible  liquids.  This  is  called  the  Marangoni  effect  [see, 
for  example,  Sternling  and  Scriven  (1959)1. 

Chemical  Reactions 

Chemical  conversions  in  tubular  reactors  are  invariably  coupled  with 
momentum  transfer  since  the  assumption  of  plug  flow  is  rarely  justifiable. 


For  example,  in  laminar  flow  through  an  empty  round  tube  the  velocity 
distribution  is  parabolic,  and  in  a  tube  filled  with  packing  is  M-shaped. 
Turbulent  flow  does  not  occur  in  practical  reactors,  with  singular  excep¬ 
tions  such  as  for  the  radiantly  stabilized  burner  discussed  subsequently. 
Mon-equimolar  reactions  in  turn  influence  the  velocity  distribution  even 
for  isothermal  conditions. 

For  homogeneous  reactions  a  velocity  distribution  implies  a  radial 
concentration  gradient  and  hence  radial  mass  transfer.  If  the  reaction 
or  reactions  are  significantly  energetic  a  radial  temperature  gradient  is 
also  necessarily  generated.  The  mass,  energy  and  momentum  equations  are 
thus  intercoupled.  As  evidence  of  the  significance  of  this  coupling,  Brian 
(1963)  has  shown  that  the  coefficient  for  heat  transfer  to  the  wall  of  a 
non-adiabatic  reactor  may  be  changed  radically  (as  much  as  a  factor  of  10) 
by  chemically  generated  or  absorbed  energy. 

In  packed  beds  of  catalyst  particles ,  heat  and  mass  interchange  with 
the  surface  of  the  pellets,  adsorption,  desorption,  surface  migration,  and 
surface  reaction  may  all  count,  and  in  the  case  of  porous  particles,  diffu¬ 
sion  of  heat  and  mass  through  the  pores  as  well.  The  thermal  conductivity 
of  the  particle  may  be  sufficient  to  justify  the  use  of  an  isothermal 
effectiveness  factor,  but  temperature  and  composition  differences  between 
the  surface  and  the  bulk  of  the  adjacent  fluid  will  generally  be  signifi¬ 
cant  [see,  for  example.  Fair  (1955)3.  It  may  be  possible  to  account  for 
some  of  these  effects  with  adequate  approximation  by  a  lumped  model,  but 
not  those  of  the  radial  velocity,  composition  and  temperature  profiles. 
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By  contrast,  for  wall -catalyzed  reactions  the  radial  profiles  of 
velocity,  composition  and  temperature  can  be  accounted  for  by  lumping, 
just  as  for  individual  catalyst  particles. 

It  is  concluded  that  tubes  with  a  surface  coating  of  catalyst  can 
be  modelled  by  ordinary  differential  equations,  but  that  homogeneous 
tubular  reactors  and  packed  catalytic  reactors  cannot  be. 

Finally,  tubular  reactors  for  endothermic  processes  are,  as  shown 
by  Calderbank  (1954)  and  others,  are  essentially  heat  exchangers.  The 
reaction  mechanism  determines  the  temperature  level,  but  the  local  rate 
of  reaction  is  in  close  proportion  to  the  local  rate  of  heat  transfer. 

Having  established  the  importance  of  heat  transfer  in  chemical  re¬ 
actors  I  will  defer  to  others  for  detailed  discussion  of  this  topic. 

Behavior  Generating  Stiffness 

Now  let  me  return  from  this  digression  on  the  interrelationships 
between  heat  transfer,  and  other  processes,  and  consider  stiffness .  My 
posture  here  will  be  as  a  customer  rather  than  as  a  supplier  of  techni¬ 
ques.  That  is,  the  following  will  be  limited  to  a  description  of  ther¬ 
mal  problems  which  pose  computational  difficulties  and  therefore  are 
worthy  of  you r  expert  attention.  I  will  also  try  to  identify  the  physi 
cal  and  mathematical  characteristics  which  lead  to  these  difficulties. 
Since  I  am  problem-oriented  rather  than  technique-oriented,  I  ask  your 
indulgence  if  some  of  these  problems  fall  outside  the  narrow  definition 
of  stiffness  as  models  composed  of  ordinary  differential  equations 
giving  rise  to  widely  separated  eigenvalues.  I  trust  that  you  of  this 
highly  selective  audience,  and  particularly  those  of  you  who  succeed 


me  at  this  podium,  will  provide  guidance  to  the  solution  of  this  broader 
class  of  problems. 


The  more  important  and  more  difficult  problems  in  heat  transfer  are 
necessarily  modelled  by  partial  differential  equations,  representing 
transient  and/or  multidimensional  behavior.  Presumably  most  of  these  prob¬ 
lems  involving  partial  differential  equations  c an  be  transformed  to  ordin¬ 
ary  differential  equations  by  standard  techniques  such  as  operational 
methods,  local  similarity,  local  non-similarity,  the  method  of  characteris¬ 
tics,  the  method  of  lines  and  the  method  of  weighted  residuals.  Hence  Z 
will  include  such  problems  in  my  discussion. 

The  following  are  then  a  representative  set  of  heat  transfer  problems 
of  varying  complexity  which  may  invoke  stiffness  or  related  computational 
difficulties.  Attention  will  first  be  directed  to  those  problems  which  can  be 
modelled  by  ordinary  differential  equations,  then  to  some  that  have  both 
one-  and  two-dimensional  aspects ,  and  finally  to  a  few  that  can  only  be 
considered  as  multidimensional. 

Heat  Exchangers 

The  interchange  of  energy  between  two  or  more  confined  streams  can  be 
represented  by  the  corresponding  number  of  ordinary  differential  equations 
for  most  geometrical  configurations  insofar  as  the  effect  of  variable  trans¬ 
port  properties  can  be  lumped.  An  example  of  an  exception  is  rectangular 
cross-flow,  which  requires  partial-differential  modelling. 

Simple  analytical  solutions  have  been  obtained  for  concurrent  and 
countercurrent  flow  with  constant  heat  capacities  and  constant  heat  trans¬ 
fer  coefficients.  Other  geometries,  developing  flow,  developing  heat 
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transfer  and  variations  in  the  physical  properties  with  temperature  may 
give  rise  to  combinations  of  differential  equations  which  are  difficult 
to  integrate  numerically.  Most  practical  problems  of  geometrical  complex¬ 
ity  only  have  already  been  solved  [see,  for  example,  Jakob  (1957)],  but 
only  a  few  of  the  simpler  cases  of  developing  flow  and  developing  heat 
transfer  have  been  considered.  The  effects  of  variable  physical  properties 
on  heat  exchange  are  still  not  well  resolved  because  of  the  lack  of  general 
models  for  the  temperature-dependence,  and  because  of  the  strong  influence 
of  variable  viscosity  and  density  on  momentum  transfer. 

Laminar  Thermal  Boundary  Layers 

Heat  transfer  in  laminar  boundary  layers,  although  a  very  old  and 
worked-over  problem,  still  offers  some  challenges,  as  illustrated  by  the 
following  two  examples. 

Low  Prandtl  Numbers.  The  boundary  layer  equations  for  free  convection  are 
numerically  intractable  for  low  Prandtl  numbers ,  apparently  because  of  in¬ 
stability.  Although  asymptotic  solutions  are  readily  derived  for  a  Prandtl 
number  of  zero,  numerical  results  have  not  been  obtained  for  any  boundary 
condition  or  geometry  for  finite  values  less  that  0.001.  Such  low  values  of 
the  Prandtl  number  only  occur  in  galactic  applications,  but  solutions  would 
be  very  useful  in  developing  correlations  for  terrestrial  applications  in  the 
generalized  form  proposed  by  Churchill  and  Usagi  (1972) . 

Recovery  Factor.  The  coupled  differential  equations  for  the  conservation  of 
momentum  and  energy  in  dissipative  flow  over  a  flat  plate  have  apparently 
never  been  solved  directly  despite  the  many  practical  applications,  including 
thermometry.  Numerical  solutions  have  been  obtained  from  an  integral  formula¬ 
tion  for  some  particular  Prandtl  numbers  [see,  for  example,  Grdber,  et  al. 
(1961)  p.  287f) . 
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Shock  Waves 

Supersonic  compression  waves  can  be  generated  by  the  motion  of  a  strong 
pressure  pulse  or  the  rapid  motion  of  a  piston.  Their  normal  reflection  off 
a  solid  surface  results  in  an  even  stronger  wave.  After  full  development, 
shock  waves  and  reflected  shock  waves  can  be  modelled  as  stationary,  insofar 
as  their  decay  due  to  dissipative  processes  can  be  neglected,  by  choosing 
the  wave  front  as  a  frame  of  reference.  Insofar  as  diffusion  and  dissipation 
are  negligible,  a  shock  wave  can  be  modelled  by  a  set  of  non-linear  algebraic 
equations  as  a  step  function  in  pressure,  velocity  and  temperature.  The 
effects  of  diffusion  and  viscous  dissipation  on  a  stationary  wave  can  be 
modelled  by  a  set  of  coupled  ordinary  differential  equations  representing  the 
conservation  of  mass,  momentum  and  energy.  Presumably  this  model  is  very 
stiff.  However,  Bird,  et  al.  (1960)  pp.  333-336,  present  an  analytical  solu¬ 
tion  which  is  exact  for  a  Prandtl  number  of  3/4.  They  also  discuss  solutions 
for  other  conditions. 

Shock  waves  may  be  generated  in  a  tube,  adding  the  complication  of  the 
drag  of  the  wall.  Spherical  and  cylindrical  waves  are  usually  postulated  to 
be  pseudo  stationary. 

Detonation  Waves 

Supersonic  compression  waves  can  also  be  generated  by  a  rapid  chemical 
reaction.  If  diffusion  and  dissipation  are  neglected  and  chemical  equilibrium 
is  assumed  behind  the  wave  the  fully  developed  behavior  can  be  modelled 
algebraically  as  a  step  function.  This  idealized  model  provides  excellent 
predictions  for  the  detonation  velocity  [see,  for  example,  Moyle,  Churchill 
and  Morrison  (I960)].  Even  so,  computations  of  the  effect  of  finite  reaction 
rates  and  diffusion  are  of  interest.  For  example,  Nicholls  (1960)  established 
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a  stationary  detonation  wave  for  a  mixture  of  hydrogen  and  oxygen  experi¬ 
mentally,  and  thereby  determined  the  reaction  rate. 

Experimental  measurements  of  the  temperature  and  pressure  reveal 
transients  which  are  presumed  to  be  due  to  the  finite  rates  of  chemical 
and  thermal  relaxation.  Computation  of  these  effects  is  a  challenging 
problem  involving  stiffness  which  must  necessarily  be  modelled  by  partial 
differential  equations. 

The  development  of  a  detonation  wave  following  ignition  is  another 
unresolved  and  challenging  problem  involving  stiffness  and  partial  differ¬ 
ential  equations. 

Deflagration  Waves 

Unconfined  laminar  flames  produce  truly  stationary  expansion  waves, 
but  the  postulates  of  chemical  equilibrium  and  negligible  diffusion  are  not 
applicable  even  as  first-order  approximations.  On  the  other  hand  the 
general  model  for  this  process  is  only  moderately  stiff.  Fristrom  (1960) 
has  shown  that  a  Bunsen  flame  can  be  modelled  satisfactorily  in  terms  of 
diffusion  and  reaction.  Hahn  and  Wendt  (1982)  have  developed  a  numerical 
solution  for  an  opposed  flat  flame,  taking  into  account  the  unique  flow 
field,  diffusion  and  free-radical  reactions. 

The  transient  problems  of  ignition  and  flame  development  provide  a 
further  challenge.  In  addition  radial  symmetry  is  of  more  direct  interest 
than  planar. 

Radiantly  Stabilized  Combustion 

The  stationary  combustion  of  premixed  air  and  fuel  (either  gas  or  an 
atomized  volatile  liquid)  in  a  refractory  tube  has  been  successfully  modelled 


by  an  ordinary  integro-differential  equation  and  a  large  set  of  coupled 
ordinary  differential  equations.  This  complex  model  is  characterized  by 
split  boundary  conditions  as  well  as  stiffness;  the  process  of  solution 
by  instability;  and  the  solutions  by  multiplicity. 

The  physical  behavior  can  be  described  as  follows.  In  passage  down 
the  inlet  region  of  the  tube  the  fuel-air  mixture  is  heated  to  the  point 
of  ignition  by  convection  from  the  tube  wall.  Combustion  then  occurs  with 
a  rapid  rise  in  temperature.  Downstream  from  this  combustion  front  the 
burned  gas  heats  the  colder  tube  wall  by  convection.  The  resulting  hot 
downstream  wall  radiates  and  conducts  energy  to  the  colder  upstream  wall 
thereby  providing  the  thermal  feedback  required  to  preheat  the  fuel-air 
mixture.  For  a  sufficiently  large  tube  diameter,  the  stable  range  of  oper¬ 
ation  falls  in  the  turbulent  regime.  Hence  the  process  can  be  modelled 
with  reasonable  accuracy  as  plug  flow.  The  model  consists  of  separate 
energy  balances  for  the  gas,  liquid  (if  any)  and  solid  (the  wall),  and 
separate  material  balances  for  each  of  the  chemical  species  in  the  gas 
phase,  including  free  radicals.  The  energy  balance  for  the  wall  is  an 
ordinary  integro-differential  equation.  The  other  balances  are  ordinary 
differential  equations.  The  energy  balances  for  the  gas  and  wall  are  coupled 
through  a  convective  boundary  condition,  and  the  energy  and  material  balances 
for  the  gas  by  the  temperature-  and  composition-dependence  of  the  reaction 
mechanisms.  In  the  case  of  liquid  droplets,  the  mass  balances  as  well  as  the 
energy  balances  for  the  gas  and  liquid  streams  are  also  coupled  through  con¬ 
vective  boundary  conditions.  Secondary  couplings  occur  due  to  physical  prop¬ 
erty  dependence  on  temperature  and  composition,  and  the  dependence  of  the 

convective  coefficients  on  the  reaction-generated  energy.  The  inlet  conditions 
are  known  for  the  fuel  and  air,  but  the  wall  temperature  at  the  inlet  is  a 
dependent  variable,  thereby  requiring  a  shooting  method  for  solution. 
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We  have  not  yet  been  able  to  obtain  a  convergent  solution  without 
making  approximations  in  the  model.  The  general  problem  involves  a  double 
iteration,  one  for  the  postulated  inlet  temperature  which  satisfies  the 
boundary  condition  of  overall  conservation  of  energy  and  the  other  for  the ■ 
temperature  distribution  in  the  integral.  Our  initial  numerical  solution 
[J.L.-P.  Chen  and  Churchill  (1972)],  although  not  convergent,  did  yield  the 
correct  behavior  semi -quantitatively  and  unexpectedly  predicted  the  existence 
of  seven  stable  solutions.  These  multiple  stationary  states  arise  from 
differences  in  the  eighth  significant  figure  of  the  trial  value  of  the  inlet 
wall  temperature.  The  inlet  wall  temperatures  which  lead  to  stable  solutions 
are  thus  equivalent  to  eigenvalues.  (The  existence  of  the  multiple  stationary 
states  has  subsequently  been  confirmed  experimentally  for  both  gaseous  and 
liquid  fuels) . 

We  have  subsequently  (Choi  and  Churchill  (1979)]  obtained  a  convergent 
solution  by  approximating  and  analytically  evaluating  the  integral  term. 
However  in  so  doing  we  lost  five  of  the  stable  solutions.  We  have  also 
carried  out  calculations  using  an  experimental  wall  temperature  profile  and 
thereby  avoiding  the  computational  difficulties  associated  with  the  integro- 
differential  component  of  the  model.  Such  calculations,  although  stiff  in 
the  sense  of  a  25  to  1  ratio  in  the  eigenvalues,  have  converged  satisfactorily 
[see,  for  example,  Tang  and  Churchill  (1981)].  The  classical  postulates  of 
quasi  steady  states  or  local  equilibrium  for  the  free  radicals  were  not  found 
to  be  valid  for  these  conditions. 


It  appears  from  this  experience  that  an  integral  term,  such  as  that 


arising  from  radiant  interchange  between  surfaces  may  be  a  more  serious 
source  of  computational  difficulty  than  widely  separated  eigenvalues  or 
split  boundary  conditions. 

The  principal  idealization  in  the  above  modelling  is  that  of  plug 
flow.  Two-dimensional  modelling  with  eddy  diffusivities  for  the  radial 
transport  of  momentum,  energy  and  species  would  undoubtedly  be  more  realis¬ 
tic.  The  principal  advantage  would  be  the  elimination  of  the  present  uncer¬ 
tain  prediction  of  the  reaction-dependent  heat  transfer  coefficient  for  the 

wall.  Calculation  of  the  transient  behavior  would  also  be  of  practical  value 
in  connection  with  ignition,  quenching  and  physical  perturbations.  Both 
radial  and  transient  modelling  require  the  use  of  partial  differential  equa¬ 
tions  without  any  relaxation  of  the  previously  mentioned  difficulties. 
Simultaneous  Radiation  and  Conduction  in  Dispersed  Media 

Radiative  transfer  through  a  dispersed  media  depends  on  scattering, 
absorption  and  reradiation.  This  behavior  can  be  modelled  by  an  integro- 
differential  equation  involving  one  to  three  dimensions  and  two  angles.  For 
the  overly  idealized  case  of  isotropic  scattering,  this  integro-differential 
equation  can  be  approximated  by  the  Poisson  equation  [see,  for  example,  Chu 
and  Churchill  (1956)  and  Chu,  Pang  and  Churchill  (1963)].  However  for 
anisotropic  scattering  this  approximation  breaks  down  near  the  boundaries, 
precisely  where  the  results  are  of  most  interest.  Lumping  the  radiation  in 
two  directions  as  proposed  by  Schuster  (1905)  or  in  three  as  proposed 
and  Churchill  (1955)  permits  approximate  modelling  by  a  set  of  non-linear, 
ordinary  differential  equations.  The  parameters  of  the  problem  all  vary 
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with  the  wavelength  of  the  radiation, . but  mean  values  can  be  postulated  as 
a  further  approximation.  The  transmission  of  solar  radiation  through  clouds 
to  the  surface  of  the  earth  is  one  application.  In  a  thermal  insulation  or 
packed  bed,  radiative  transfer  may  also  be  coupled  with  thermal  conduction. 
To  be  rigorous,  conduction  in  the  solid  and  vapor  phases  must  be  considered 
individually,  but  as  an  approximation,  a  combined,  effective  conductivity 
may  be  used  to  represent  both  phases . 

These  simplified  models  for  radiative  transfer  and  combined  radiative 
and  conductive  transfer  may  still  pose  stiff  problems,  particularly  if  the 
reflectivity  of  one  or  both  of  the  boundaries  is  near  unity  [see,  for 
example,  Larkin  and  Churchill  (1959)  and  J.C.  Chen  and  Churchill  (1963)]. 
Thermal  Regenerators 

The  fully  developed  temperature  profile  in  a  thermal  regenerator  can 
be  modelled  as  stationary.  If  the  solid  and  fluid  are  postulated  to  be  at 
thermal  equilibrium  locally,  and  if  diffusion  is  neglected  in  both  phases, 
the  process  can  be  modelled  algebraically  as  a  step  function.  K.  Chen  and 
Schiesser  (1980)  solved  the  transient  model  [which  they  call  the  advection 
equation]  for  this  limiting  behavior  numerically,  but  stiffness  resulted  in 
considerable  inaccuracy.  The  superimposed  effect  of  diffusion  can  be 
modelled  by  one  ordinary  differential  equation  and  finite  convective  resis¬ 
tance  by  two. 

This  stationary  model  is  not  valid  for  the  fundamentally  transient  be¬ 
havior  near  the  inlet  and  outlet  of  the  regenerator,  which  requires  model¬ 
ling  by  one  partial  differential  equation  in  the  case  of  diffusion  and  two 
in  the  case  of  convection.  Cyclic  operation  introduces  the  further  compli¬ 
cation  of  a  different  initial  temperature  distribution  for  each  cycle, 
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although  an  asymptotic  initial  distribution  will  be  appro  ached  after  many 
cycles . 

Abbrecht,  Churchill  and  Chu  (1957)  have  reviewed  some  of  the  analy¬ 
tical  solutions  in  series  form  and  in  terms  of  high-order  functions. 
Interestingly,  the  stiffness  of  the  various  models  appears  to  have  a 
counterpart  in  the  numerical  evaluation  of  these  analytical  solutions. 

Wave-like  Mass  Transfer 

Ion  exchange  and  gas-phase  chromatography  bear  some  analogy  to  ther¬ 
mal  regeneration  but  are  generally  more  complicated. 

The  dispersion  of  CO^  and  0^  in  the  process  of  respiration,  as  des¬ 
cribed  by  Boy  (1981),  is  also  somewhat  analogous,  although  the  conical 
shape  of  the  bronchial  tubes,  etc.,  introduces  a  different  set  of  compli¬ 
cations  . 

Thermoacoustic  Waves 

A  sonic  compression  wave  is  generated  in  an  unconfined  gas  by  a  step 
increase  in  the  temperature  of  a  bounding  surface.  If  the  gas  is  confined, 
the  wave  reflects  repeatedly.  Ozoe  and  Churchill  (1980)  failed  to  obtain 
a  convergent  numerical  solution  for  this  problem  owing  to  stiffness,  although 
their  computed  pseudo  steady-state  pressures,  velocities  and  temperatures  are 
self -consistent . 

Forced  Convection 

Developing  heat  transfer  in  forced  convection  noses  a  fundamentally 


two-dimensional  problem.  Graetz  derived  a  series  solution  for  the  temperature 
field  and  heat  transfer  coefficient  in  fully  developed  laminar  flow  in  a  round  tube  due 


to  a  step  in  wall  temperature.  However,  this  series  does  not  converge 
for  short  distances  from  the  onset  of  heating.  Lev^que  used  a  similarity 
transformation  to  derive  an  approximate  solution  for  the  inlet  region, 
which  is  correct  in  the  limit  but  not  for  finite  distances.  Worstfe-Schmidt 
developed  a  series  solution  in  the  form  of  a  perturbation  on  the  Lev^que 
model  which  is  valid  for  small  distances  but  not  for  large.  A  number  of 
numerical  solutions  have  been  attempted  but  none  are  accurate  as  the  inlet  is 
approached  owing  to  the  ever-decreasing  thickness  of  the  boundary  layer. 

Many  closely  related  problems  have  been  considered  for  other  geometries, 
other  boundary  conditions  and  developing  flow.  They  all  have  the  same 
limitations.  More  detailed  description  of  these  problems  as  well  as  refer¬ 
ences  to  the  original  work  are  given  by  Grober,  et  al.  (1961),  Churchill 
and  Usagi  (1972)  and  Churchill  and  Ozoe  (1973a,  1973b) . 

Transient  Conduction 

Transient  thermal  conduction  in  multiple,  solid  media,  such  as  an  insu¬ 
lated  semi -infinite  region  subjected  to  a  step  in  surface  temperature  [see, 
fcr  example,  Churchill  (1965)]  may  pose  computational  difficulties. 

The  non-linear  boundary  condition  provided  by  a  phase  transition,  such 
as  in  the  freezing  of  wet  soil,  particularly  in  two  or  three  dimensions,  may 
introduce  computational  problems  related  to  the  location  of  the  phase 
boundary  [see,  Churchill  and  Gupta  (1977)]. 


nearly  discrete  shifts  from  single-particle  heating,  to  a  pseudo  steady- 
state  to  interparticle  effects  [see  Sleicher  and  Churchill  (1956)]. 
Instability 

Physical  instability  may  cause  computational  difficulties  which  are 
similar  to  those  associated  with  stiffness.  For  example,  the  mode  of 
circulation  for  natural  convection  in  an  enclosure  heated  from  below  changes 
from  multiple  roll  cells  with  axes  parallel  to  the  shorter  horizontal  dimen¬ 
sion  to  a  single  circulation  with  its  axis  parallel  to  the  axis  of  inclina¬ 
tion.  The  computed  values  oscillate  chaotically  instead  of  converging  for 
inclinations  near  the  critical  value  (see,  for  example,  Ozoe,  Yamamoto  and 
Churchill  (1979) ] . 

Summary  and  Conclusions 

I  have  now  completed  my  physical  description  of  a  representative  set 
of  problems  in  heat  transfer  whose  numerical  solution  is  known  or  suspected 
to  encounter  computational  problems.  I  have  also  noted  some  problems  in 
mass  transfer  which  are  computationally  analogous  and  some  in  which  heat 
transfer  is  coupled  with  momentum  transfer,  mass  transfer  and  chemical  re¬ 
actions.  I  have,  however,  avoided  the  discussion  of  heat  transfer  in  laminar 
tubular  and  packed-bed  reactors,  per  se,  out  of  deference  to  other  speakers. 

Most  important  unsolved  problems  in  heat  transfer  (as  well  as  in  mass 
transfer,  momentum  transfer  and  chemical  kinetics)  are  found  to  be  either 
transient  or  multidimensional. 

Shock,  detonation,  deflagration  and  thermoacoustic  waves,  thermal 


regeneration,  ion  exchange',  gas-phase  chromatography,  respiration,  and 
radiantly  stabilized  combustion,  with  dispersion  due  to  diffusion,  chemi¬ 
cal  reactions  and/or  interphase  transfer,  whether  stationary  or  transient, 
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pose  classical  problems  of  stiffness.  That  is,  the  stiffness  is  associated 
with  different  terms  with  widely  varying  time  constants  or  the  equivalent. 

The  simplified  model  for  radiative  and  conductive  transfer  through 
dispersed  material,  and  the  illustrative  model  for  transient  radiant  heat¬ 
ing  of  a  dispersion  of  particles  are  similarly  stiff  owing  to  discordant 
mechanisms  of  heat  transfer.  This  same  effect  occurs  in  the • transient 
heating  of  an  insulated  semi-infinite  media  and  in  the  freezing  of  a  semi¬ 
infinite  region  of  wet  soil.  (Locating  the  freezing  front  further  compli¬ 
cates  the  latter  problem,  particularly  in  two  or  three  dimensions) . 

On  the  other  hand  the  original  integro-dif ferential  model  for  radia¬ 
tive  transfer  through  a  dispersion  and  the  integro-differential  equation 
in  the  model  for  radiantly  stabilized  combustion  generate  even  more  severe 
computational  difficulties. 

Split  boundary  conditions  are  a  source  of  difficulty  in  some  boundary 
layer  and  heat  exchanger  problems,  and  also  in  solving  the  model  for 
radiantly  stabilized  combustion. 

The  generation  of  a  thermoacoustic  wave  by  a  step-function  in  temper¬ 
ature  at  the  boundary  appears  to  pose  a  uniquely  stiff  problem. 

Physical  instability,  such  as  that  associated  with  low  values  of  the 
Prandtl  number  in  free  and  natural  convection  and  with  changes  in  the  mode 
of  circulation  in  natural  convection,  is  another  severe  source  of  computa¬ 
tional  difficulty. 

In  conclusion,  I  hope  that  this  physical  description  of  important  and 
computationally  difficult  problems  in  heat  transfer  has  provided  some  new 
challenges  for  vou. 


-1—  V 
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ABSTRACT 


Detailed  model*  of  the  flat,  laminar ,oppoeed  Jet  diffueion  flam*  Involve 
the  solution  of  the  momentum,  energy  and  species  conservation  equations 
coupled  with  stiff  chemical  kinetics*  The  problem  has  self  similar  solutions 
and  can  be  solved  through  numerical  integration  of  a  set  of  second  order, 
stiff,  boundary  valued,  ordinary  differential  equations,  each  with  a  regular 

first  order  turning  post  arising  from  convection* 

•  • 

Finite  difference  discretisation  (in  the  spatial  domain)  end  expansion  of 
the  reaction  rate  source  terms  in  e  Taylor  series  about  the  backward  iteration 
(in  the  temporal  domain),  leads  to  a  matrix  equation,  the  solution  of  which  is 
obtained  through  LU  decomposition.  Modification  of  standard  discretisation  to 
allow  convergence  to  be  obtained  with  a  minimum  of  grid  points  was  required, 
and  is  described  in  detail. 

Predicted  profiles  of  major  and  minor  species  provide  useful  insight  into 
the  use  of  the  laminar  opposed  Jet  diffusion  flame  configuration  to 
Investigate  detailed  kinetic  mechanisms  under  a  wide  range  of  conditions* 


The  Problem 


The  laminar  opposed  jet  diffusion  flame.  Figure  1  is  a  combustion 
configuration  that  possesses  a  number  of  useful  attributes*  First,  it  allows 
a  flat  flame  to  be  established  in  space,  without  direct  Influences  of  burners 
or  possible  catalytic  surfaces;  second,  It  allows  Investigation  kinetic 
mechanisms  occurring  in  hot  fuel  rich  regions  and  over  a  wide  range  of 
conditions,  which  due  to  flammability  limitations,  cannot  be  established  in 
the  premixed  mode;  third,  it  may  be  thought  to  represent  a  prototype  model  of 
laminar  flamelets,  each  of  which  is  strained  in  its  own  plane,  and  which 
represent  the  reaction  zones  important  in  turbulent  diffusion  flames*  Its 
usefulness  as  a  tool  to  test  and  corroborate  detailed  kinetic  mechanisms  rests 
on  its  ability  to  be  modeled  and  on  the  power  of  numerical  procedures  to 
enable  accurate  solution  of  the  ensuing  stiff  ordinary  boundary  valued 
differential  equations  to  be  achieved* 

Unlike  previous  work  (Fendell,  1965;  Krlshnamurthy  and  Williams,  1974) 
which  has  focused  on  analytical  solutions  of  models  utilizing  simplified 
combustion  chemistry  with  either  infinitely  rapid  chemical  reactions  or  a 
simple  reaction  with  a  very  high  activation  energy  (Peters,  1978),  this  paper 
focuses  on  numerical  procedures  necessary  to  solve  the  problem  for  an 
arbitrary  large  set  of  reactions  describing  the  free  radical  combustion 
chemistry  pertinent  to  this  flame.  The  eauatlons  describing  the  laminar 
opposed  jet  diffusion  flame  comprises  a  severe  test  of  any  numerical 
Integration  schema.  The  problem  is  a  boundary  valued  problem  with 
concentrations  and  temperature  set  at  ±«  .  Moreover,  this  is  one  of  the 
cases  in  nature  where  there  is  direct  coupling  between  the  energy  and  the 
momentum  balances  through  the  changes  in  gas  density  p  •  An  accurate 
prediction  of  the  (non  linear)  velocity  profile  is  essential  since  this  has  a 
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/Stagnation 


first  order  Influence  on  ell  other  profiles.  Inclusion  of  the  effects  of 
viscosity  and  other  dynamic  effects  on  the  overall  concentration  profiles, 
together  with  chemical  reaction,  distinguishes  this  problem  from  that  of  the 
one  dimensional  premixed  flat  flame,  where  the  velocity  profile  can  be 
calculated  from  kinematic  considerations  alone. 

The  reaction  zone  thickness  depends  on  a  parameter,  e  ,  the  rate  of 
stretching,  and  very  steep  spatial  gradients  in  concentrations,  temperature, 
reaction  rates  are  the  norm  rather  than  the  exception.  A  detal'ed  combustion 
chemistry  mechanism  typically  consists  of  many  free  radical  reactions  with 
characteristic  times  differing  by  over  thirty  orders  of  magnitude  at  a  point 
in  space.  This  naturally  introduces  problems  associated  with  stiffness,  and 
special  techniques  must  be  Implemented  to  overcome  them.  The  purpose  of  this 
paper  is  first  to  survey  the  problem  qualitatively  in  order  to  present  an 
engineering  example  of  where  and  how  stiffness  manifests  itself  in  practice, 
and  second,  to  present  the  approaches  used  to  solve  this  particular  problem. 
These  approaches  address  both  the  problem  of  stiffness  and  that  associated 
with  the  steep  gradients  occurring  in  the  spatial  domain  near  the  reaction 
zone. 

Self  Similar  Solution  of  the  Governing  Equations 

A  complete  description  of  the  system  shown  on  Figure  i  Involves  the 
simultaneous  solution  of  the  following  equations  in  cylindrical  coordinates: 
1.  Continuity: 
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2*  r  momentum: 
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3.  z  momentum: 
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4.  Energy: 
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5.  Species: 
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6.  Ideal  Gas  Law: 


P/c  -  RT 

In  the  above  equations,  pseudo  binary  diffusion  has  been  assumed  and 
radlatlva  heat  losses  and  thermal  diffusion  have  been  neglected  following 
Field  et.  al.  (1967),  The  time  dependence  haa  been  retained  since  we  wish  to 
solve  these  equations  from  an  Initial  guess  at  t  *  0  to  the  steady  state  at 
t  ♦  •  . 


4 


The  boundary  conditions  to  equations  (1)  through  (6)  are: 
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It  can  be  shown  that  Equations  (1) 

through  (5) 

can  be  reduced  to 

a  system 

or  ordinary  differential  equations  by  assuming  self 

similar  solutions 

of  the 

following  forms: 

vf  -  er^(z)  ;  -  v(z) 

(12) 

3P  .  3?  ,  . 

f (r)  ;  -gy  -  g(z) 

(13) 

p  »  p(z)  ;  T  -  T(z)  ;  xA  -  xA(z) 

(14) 

Furthermore,  since 


1c  can  be  shown  (Hahn,  1979) ,  that  the  proposed  self  similar  solution  is 
consistent  with  the  equations,  which  now  become  totally  independent  of  r.  It 


T  -  T 


is  convenient  to  define  a  dimensionless  temperature  as  8 
the  following  differential  equations  to  be  solved: 


,  to  yield 


Mass: 
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The  z  momentum  equation  plays  no  role  other  than  to  calculate 
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Of  interest  *-*  the  solution  as  t  ■>  »  when  the  left  hand  sides  of  these 
equations  are  equal  to  zero.  This  is  the  desired  one  dimensional  steady  state 
solution.  It  should  be  noted  that  all  physical  and  transport  properties  are 
allowed  to  vary  with  position.  Simplifying  assumptions  with  respect  to 
diffusion  can  be  made,  depending  on  which  level  of  complication  for  DA,  the 
pseudo  binary  diffusion  coefficient,  is  appropriate. 

Numerical  Solution 

The  equations  (16)  through  (18)  were  solved  numerically  in  a  time 
dependent,  fully  implicit  and  fully  coupled  mode.  These  equations  have  the 
form 

2 

3c 

sr '  Ai<‘>  ~4  +  Bi(t)  -sr  ♦  Di(I>  ci  +  Ri(I>  <»»> 

3z 

i  -  1  ...  NS4-2 


where  the  coefficients  are  given: 
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If  che  domain  in  which  a  solution  is  sought  is  given  by 


-  til  <  *  <  +  Hi 


the  boundary  conditions  for  all  the  x A  and  6  values  are  specified,  while  for 
♦  : 


*  -  1 


*  -  -  m 


Continuity  (Equation  IS) 
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is  solved  separately  in  the  spatial  domain 

3p 

5t 


(21) 


where 


3p  (MW)P  3(T) 
3t  “  R  3t 


(22) 


Stiffness  in  Equation  (19)  arises  through  the  term  R^(s)  which  is  the  forcing 
function  due  to  detailed  combustion  chemical  reactions.  The  coefficient  B^(z) 
changes  sign  in  the  neighborhood  of  the  stagnation  plane,  causing  a  regular 
first  order  turning  point. 

An  explicit  approach  to  solve  Equation  19  is  to  evaluate  A^,  B^,  and 
using  values  of  a  previous  iteration  and  solve  for  ,  thus  decoupling  the 
system  of  equations  and  leading  to  inversion  of  a  series  of  tridiagonal 
matrices.  This  was  attempted  but  failed.  Tyson  (1964)  developed  a  technique 
for  solution  of  systems  of  stiff  Initial  valued  problems  in  which  the  term 
R^(z)  is  expanded  about  the  backward  time  step.  This  idea  was  later  used  by 


W«r«lt  et.  *1.  (1979)  to  solve  systeas  of  stiff  boundary  valued  problems  and 
forms  the  centerpiece  for  the  solution  method  utilized  In  this  work.  Thus 
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with  N  -  NS+2  and  k  refers  to  the  time  step.  This  expansion  Is  performed  at 
each  grid  point  p. 

Standard  Finite  Difference  Discretization 

Both  a  collapsing  and  an  equally  spaced  grid  were  used  with  standard 
finite  difference  discretization.  The  appropriate  formulas  are 
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F  gathers  all  raaalning  Carat  known  at  the  k'ch  Cine  step  and 
C’P  * 

o.  ,  8 4  .i  and  y.  aa  wall  at  -ex-  are  also  evaluated  at  the  known  k'ch 
i,p  l, p  l ,p  «Cj 

step.  If  a  it  Che  nuaber  of  grid  points  equations  (26)  represents  a  sec  of 
(N.a)  simultaneous  algebraic  equations  for  the  values  of  the  Increaents 
AC.  for  a  time  step  At  .  The  system  can  be  rearranged,  using  matrix 
notation,  as  follows  (Wendt  et.  al.,  1979): 


A  A  C  -  -  P 


where  A  Is  a  (axN)  x  (axN)  block  trldlagonal  matrix,  l.e.  an  mxm  matrix  In 
which  each  element  is  a  NxN  matrix.  The  diagonal  (NxN)  blocks  are  full, 
nondlagonally  dominant  (depending  on  At  )  matrices  while  the  off  diagonal 
blocks  are  diagonal  matrices. 

Classical  block  trldagonal  matrix  Inversion  logic  (Wendt  et.  al.,  1979) 
was  not  successful  In  solving  the  flame  problems  attacked  In  this  work. 
However,  use  was  made  of  the  fact  that  A  Is  also  a  band  matrix  and  therefore 
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the  solution  to  (31)  can  be  obtained  employing  LU  decomposition ,  which  was 
found  to  be  very  efficient  for  this  type  of  problem  (Peaceman,  1977)*  This 
method  also  saves  core  storage,  since  only  the  band  of  dimension  2Nx(mxN)  need 
be  treated. 

With  the  equally  spaced  grid.  As  ,  -  A*  ,  and  a  large  number  of  grid 

P~1  K*"  1 

points  must  be  used  when  the  reaction  cone  Is  thin  and  gradients  are  steep. 

For  example,  with  a  00  flame,  8  species  and  7  reactions  and  with 
e  •  10  sec*1,  101  grid  points  were  employed  to  obtain  a  solution,  while  35 
grid  points  were  Insufficient  for  proper  resolution  of  the  peaks. 

Since  systems  Involving  35  species  or  more  are  common  In  this  type  of 
problem,  It  was  clear  that  a  discretisation  allowing  fewer  grid  points  was 
essential.  This  forced  utilisation  of  a  collapsing  grid. 

The  collapsing  grid  Is  shown  in  Figure  2  and  was  automatically  adjusted 
as  follows.  The  location  of  the  peak  in  the  temperature  profile  was 
determined  and  a  grid  was  created  to  the  left  with  a  specified  expansion 
factor.  The  expansion  factor  for  the  right  side  was  then  determined  such  that 
both  Intervals  next  to  the  peak  temperature  location  were  equal  and  such  that 
an  equal  number  of  grid  points  were  located  on  each  side.  This  method  allowed 
the  CO  opposed  jet  diffusion  flame  to  be  solved  with  35  grid  points,  provided 
that  the  stretching  rate  e  ,  was  less  than  7  sec-^.  In  these  cases  the 
equally  spaced  grid  with  35  grid  points  was  too  coarse  in  the  neighborhood  of 
the  peak  temperature  to  allow  convegence.  However,  at  e  >  7  sec*1  the 
collapsing  grid  was  also  prone  to  problems  due  to  nonsymmetrlc  numerical 
diffusion  of  errors,  and  this  led  to  oscillations  and  an  inability  to  satisfy 
the  boundary  conditions.  This  is  described  in  detail  below. 

The  burner  spacing,  i,  or  domain  In  which  the  problem  was  being  solved, 
was  automatically  adjusted  so  that  there  was  not  net  flux  of  heat  or  any 
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Difference  Solution. 


•pedes  into  either  of  the  burners.  Thus  the  distance  t  could  be  increased  by 
50Z  if.  at  any  Iteration,  any  net  flux  had  the  incorrect  sign  at 
:  »  +  £  or  *  •  Likewise,  t  could  be  autoaatlcally  decreased  by  2/3  if 
the  teaperature  profile  Indicated  that  greater  resolution  was  appropriate. 
Whenever  the  grid  had  to  be  ajusted,  the  new  values  of  all  variables  were 
obtained  by  linear  Interpolation  between  values  at  the  previous  grid  points. 

The  original  initial  estimate  of  profiles  at  t  >  0  was  from  the  classical 
Burke  Shumann  flame  with  an  infinitessimally  thin  reaction  zone,  together  with 
arbitrary  free  radical  profiles  to  facilitate  ignition.  Much  computer  time 
can  be  saved  if  intermediate  nonconverged  or  converged  results  are  saved  and 
used  as  the  initial  guesses  for  the  next  run.  The  adjustable  time  step  was 
controlled  entirely  by  the  temperature  profile,  allowing  changes  of  1Z  at  any 
point  in  any  time  Interval.  At  convergence  to  steady  state,  determined  by 
relative  changes  of  all  variables,  the  time  step  had  become  very  large, 
greater  than  1  sec.  This  typically  occurred,  from  a  'reasonable*  initial 
guess  within  200  to  400  interations,  from  an  initial  At  -  10~*  sec  . 

Modified  Central  Difference  Discretization 

When  solving  the  model  corresponding  to  the  opposed  jet  diffusion  flame 
with  a  high  rate  of  stretching,  numerical  oscillations  were  observed  in  the 
temperature  profile,  the  $  profile  and  the  reactant  profiles.  These 
undulations  occur  close  to  the  boundaries  of  the  domain  and  do  not  statlsfy 
the  boundary  conditions  and  thus  prevent  convergence.  These  instabilities 
originated  from  the  collapsing  grid  and  diffusion  of  numerical  errors  towards 
the  boundaries.  Yet,  a  collapsing  grid  is  essential  in  order  to  handle  the 
sharp  temperature  profiles  in  the  center  with  less  than  35  grid  points 
overall.  One  solution  was  to  use  100  equally  spaced  grid  points  and  this 
appeared  to  allow  convergence.  However,  this  large  number  of  grid  points 
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constrained  the  program  to  solution  of  relatively  saall  kinetic  problems  (due 
to  core  storage  limitations)  and  did  not  allow  investigation  of  hydrocarbon 
plus  fuel  nitrogen  chemistry  together.  Since  the  latter  was  the  key  aspect  of 
modeling  in  this  work,  these  results  put  us  on  the  horns  of  a  dilemma. 

This  dilemma  was  ultimately  resolved  by  developing  a  modified  central 
difference  discretisation  in  which  the  first  and  second  derivations  are  given 
by  (for  equally  spaced  grids) : 


(32) 

(33) 


with  the  weighting  functions  Wj »  Wl,p-1»  W2,p*-1  *nd  W2,p»l  c*lculat«d 
described  in  the  Appendix.  The  essence  of  this  approach  is  to  approximate  the 
differential  equations  to  be  solved  within  a  mesh  Interval,  rather  than  the 
solutions  to  the  equations.  Thus,  this  discretisation  is  exact  for  linear 
ODE's  with  constant  coefficients  and  constant  forcing  functions  while  the 
conventional  discretisation  is  not.  Since  the  opposed  jet  diffusion  flame 
equations  are  certainly  not  linear,  the  modified  discretisation  is  not  exact, 
but  is  superior  as  long  as  the  solutions  to  the  equations  behave  more  like  a 
sum  of  exponentials  than  a  quadratic  function  of  s. 

Implementation  of  the  modified  discretisation  resulted  in  solution  of  the 
opposed  jet  diffusion  flame  model,  with  CO  kinetics  and  with  a  stretching  rate 
e  •  10  sec'1  ,  with  35  grid  points.  This  was  not  possible  with  standard 
discretisation  with  either  collapsing  or  uniform  grids,  in  which  cases  no 
convergence  could  be  achieved.  With  uniform  standard  discretisation 
convergence  was  obtained  with  101  grid  points.  Therefore  the  modified 
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discretization  allowed  the  minimum  number  of  mesh  points  to  be  reduced  from 
101  to  35  and  this  allowed  development  of  a  general  purpose  laminar  opposed 
jet  diffusion  flame  code. 

The  program  also  allowed  the  laminar  opposed  jet  diffusion  flame  model 
for  a  CH4/O2/N2  flame  to  be  solved.  This  involved  16  species  and  39 
(reversible)  reactions.  Core  limitations  required  the  use  of  not  more  than  35 
grid  points  for  this  case.  Neither  the  evenly  spaced  grid  nor  collapsing  grid 
with  standard  discretization  allowed  a  convergent  solution  to  be  found.  The 
modified  discretization  did  converge,  indicating  again  the  necessity  of  this 
approach. 

General  Purpose  Code 

The  general  purpose  code  developed  allows  an  arbitrary  reaction  set 
containing  up  to  150  reactions  and  70  species  to  be  interpreted  and  solved  for 
the  laminar  opposed  jet  flame  configuration.  Diffusion  coefficients,  thermal 
conductivities,  viscosities  and  thermochemlcal  properties  are  supplied  in  the 
program.  These  are  calculated  from  the  proper  Leonard  Jones  and  Stockaayer 
lntermolecular  potential  parameters  and  from  the  NASA  equilibrium  tape. 
Appropriate  mixing  rules  including  the  blfuractlon  approximation  for 
multicomponent  diffusion  are  incorporated.  Table  1  shows  a  sample  input  for  a 
carbon  monoxide  reaction  set  utilized  in  the  results  presented  here.  This 
resctlon  set  was  obtained  from  a  recent  review  of  CO/H2/O2  kinetics  by  Corley 
and  Bowman  (1982).  The  data  can  be  listed  in  any  order  and  a  free  format 
input  is  utilized  to  aid  in  the  use  of  the  program.  The  program  requires  the 
stretching  rate  as  an  input  parameter  and  adjusts  the  burner  spacing 
automatically  such  that  there  is  no  net  flux  of  any  species  back  into  either 
of  the  burners.  Appropriate  velocities  are  calculated  and  this  is  used  in  the 
design  of  the  experimental  configuration. 
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Table  1  Data 

Input  to  LOJDF  Coda 

STOICH'COR 

1, 

CO  ♦  0 

♦  U  *  C02  * 

H 

FRATCO'COR 

1, 

0.3800E+2S, 

-3.00,  6.170, 

* 

RRATCO'COR 

1, 

0.3319E+31 , 

-4.00,133.331, 

STOICH'COR 

2, 

CH20  ♦  N 

■  HCO  * 

H 

+  H 

FRATCO'COR 

2' 

0.3310E+I7, 

0.00,  81.020, 

" 

RRATCO'COR 

2, 

0.1929£*12, 

1. 00,-10.532, 

ST0ICH,C0R 

3, 

HCO  *  H 

*  H  + 

CO 

♦  N 

FRATCO.COR 

3, 

0.J330E-M3, 

0.0 0,  14.675, 

RRATCO'COR 

3, 

0.7430E+11, 

1.00,  -1.863, 

STOICH'COR 

♦, 

H2  ♦  H 

■  H  *■ 

H 

♦  H 

FRATCO'COR 

4, 

0.2080E+16, 

0.07,103.830, 

RRATCO'COR 

4, 

0.2203E+12, 

1.07,  -1.311, 

STOICH'COR 

5' 

H20  ♦  H 

•  OH  ♦ 

H 

♦  H 

FRATCO'COR 

3, 

0.2300E+23, 

-2.00,122.600, 

RRATCO'COR 

5, 

0.4978E+2O, 

-1.00,  1.903, 

STOICH'COR 

4, 

0  *  0 

♦  N  *  02  ♦ 

M 

FRATCO'COR 

it 

0.1000E+19, 

-1.00,  0.000, 

RRATCO'COR 

0.6919E+23, 

-2.00, t19. 977, 

STOICH'COR 

7, 

H202  ♦  M 

•  OH  ♦ 

OH 

*  N 

FRATCO'COR 

7, 

0.1200E+18, 

0.00'  45.300, 

RRATCO'COR 

7f 

0.3993E+12, 

1.00,  -6.305' 

STOICH'COR 

Of 

H  ♦  02 

♦  N  •  H02  + 

N 

FRATCO'COR 

8, 

0.1300E+16, 

0.00,  -1.000, 

RRATCO'COR 

Of 

0.6033E+19, 

-1.00'  47.352, 

STOICH'COR 

0, 

H  ♦  02 

-  OH  ♦ 

0 

FRATCO'COR 

Of 

0.4300E-H1, 

1.00,  14.803, 

RRATCO'COR 

Of 

0.2769E+10, 

1.00,  -1.860, 

STOICH'COR 

JO, 

H2  *  0 

*  OH  ♦ 

H 

FRATCO'COR 

10, 

0.1800E+1 J , 

1.00,  8.900, 

RRATCO'COR 

10, 

0.81 13E+10, 

1.00,  6.871, 

STOICH'COR 

tt, 

OH  ♦  OH 

«  H20  ♦ 

0 

FRATCO'COR 

It, 

0.2140E+10, 

1.11,  0.000' 

RRATCO'COR 

It' 

0.2322E+11 , 

1.11,  17.383, 

STOICH'COR 

12, 

OH  ♦  H2 

»  H20  + 

H 

FRATCO'COR 

12, 

0.1100EH0, 

1.60,  3.464, 

RRATCO'COR 

12, 

0.5382E+10, 

1.60,  13.818, 

STOICH'COR 

13, 

H  ♦  H02 

■  OH  ♦ 

OH 

FRATCO'COR 

13, 

0.2300E+J5' 

0.00,  1.900, 

RRATCO'COR 

13, 

0. 1628E+14, 

0.00,  40.194, 

STOICH'COR 

M, 

OH  ♦  H02 

*  H20  ♦ 

02 

FRATCO'COR 

14, 

0.5000E+14, 

0.00,  1.000, 

RRATCO'COR 

14, 

0.5741EH3, 

0.00,  73.343, 

STOICH'COR 

13, 

0  ♦  H02 

•  OH  ♦ 

02 

FRATCO'COR 

13, 

0.3000E-H4, 

0.00,  1.000, 

RRATCO'COR 

13, 

0.3290E+14, 

0.00,  33.960, 

STOICH'COR 

14, 

H  ♦  H02 

•02  ♦ 

H2 

FRATCO'COR 

14, 

0.2300E+14, 

0.00,  0.700' 

RRATCO'COR 

14, 

0.3867E+14, 

0.00,  37.689, 

STOICH'COR 

17, 

H2  ♦  02 

*  OH  ♦ 

OH 
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Table  1 


continued 


fratco,cor 

17, 

0.2300E+13, 

0.00, 

39.000, 

, 

RRATCOfCOR 

17, 

0.6933E+1 1 , 

0.04, 

20.303, 

K- 

ST0ICH,C0R 

18, 

H02  ♦  H2 

a  H202  + 

H 

FRATCO,CQR 

18, 

0.3000E+1 2, 

0.00, 

18.680, 

■I 

RRATCOf COR 

18, 

0.6216E+12, 

0.00, 

3.638, 

0 

STOICH,COR 

1?, 

H02  *  H02 

•  H202  + 

02 

FRATCOfCOR 

19, 

0.2000E+13, 

0.00, 

0.000, 

RRATCO,COR 

19, 

0.9725E+13, 

0.00, 

41.947, 

STOICH,COR 

20, 

H202  ♦  H 

■  H20  + 

0H 

FRATCO,COR 

20, 

0.3000E+13, 

0.00, 

9.000, 

m 

RRATCO,COR 

20, 

0.46I2E+14, 

0.00, 

77.690, 

B 

STOICHfCOR 

21, 

H202  +  OH 

»  H20  ♦ 

H02 

FRATCOfCOR 

21, 

0.1000E-H4, 

0.00, 

1.000, 

RRATCO,COR 

21, 

0.236JE+14, 

0.00, 

31.396, 

STOICH,CQR 

22, 

CO  *  OH 

*  C02  ♦ 

H 

FRATCOfCOR 

22, 

0.I500E+08, 

1.30, 

-0.763, 

RRATCOFCOR 

22, 

0.3340E+10, 

1.30, 

23.304, 

■ 

STOICHf COR 

23, 

CO  ♦  H02 

a  C02  ♦ 

OH 

FRATCOfCOR 

23, 

0.I000E+12, 

0.00, 

10.000, 

RRATCO,COR 

23, 

0. 1337E+13, 

0.00, 

72.364, 

STOICHfCOR 

24, 

CO  ♦  02 

»  C02  + 

0 

FRATCOfCOR 

24, 

0.4905E+08, 

1.00, 

34.810, 

*.  ■. 

RRATCOfCOR 

24, 

0.1003E+10, 

1.00, 

42.214, 

STOICHfCOR 

23, 

HCO  ♦  H 

*  CO  + 

H2 

FRATCOfCOR 

25, 

0.2000E+15, 

0.00, 

0.000, 

^  * 

RRATCOfCOR 

23, 

0.9033E+13, 

0.00, 

88.803, 

STOICHfCOR 

26, 

HCO  ♦  0 

a  CO  ♦ 

OH 

„  ■ 

FRATCOfCOR 

24, 

0.5300E+13, 

0.30, 

0.000, 

■ 

RRATCOfCOR 

24, 

0.1 122E+14, 

o.so. 

86.774, 

STOICHfCOR 

27, 

HCO  +  0 

*  C02  + 

H 

... 

FRATCOfCOR 

27, 

0.5300E+13, 

0.30, 

0.000, 

RRATCOfCOR 

27, 

0.2649E+16, 

0.30, 

110.843, 

STOICHfCOR 

28, 

HCO  +  OH 

»  CO  ♦ 

H20 

FRATCOfCOR 

28, 

0.3000E+1 1 , 

1.00, 

0.000, 

■ 

RRATCOfCOR 

28, 

0.4644E+12, 

t.oo, 

104.137, 

IS* 

STOICH,COR 

29, 

HCO  ♦  02 

a  CO  + 

H02 

FRATCOfCOR 

29, 

0.5000E+12, 

0.30, 

0.834, 

.■  • 

RRATCOfCOR 

29, 

0. 94446*12, 

0.30, 

32.648, 

STOICHfCOR 

30, 

HCO  ♦  HCO 

»  CH20  + 

CO 

FRATCOfCOR 

30, 

0.4000E+14, 

0.00, 

0.000, 

•• 

RRATCOfCOR 

30, 

0.3290E+I6, 

0.00, 

75.034, 

y 

STOICHfCOR 

31, 

CH20  ♦  H 

»  HCO  + 

H2 

FRATCOfCOR 

31, 

0.2300E+11, 

1.00, 

3.200, 

RRATCOfCOR 

31, 

0.1374E+10, 

1.00, 

16.969, 

l  ' 

STOICHfCOR 

32, 

CH20  ♦  OH 

»  HCO  + 

H20 

FRATCOfCOR 

32, 

O.SOOOE+tO, 

t.oo, 

1.650, 

RRATCOfCOR 

32, 

0. 1 344E+10, 

1.00, 

30.773, 

r 

STOICHfCOR 

33, 

CH20  ♦  0 

»  HCO  ♦ 

OK 

1*-: 

FRATCOfCOR 

33, 

0. 1 300E+1 1 , 

1.00, 

2.030, 

RRATCO,COR 

33, 

0.3225E+09, 

1.00, 

13.790, 

STOICHfCOR 

34, 

CH2Q  ♦  H02 

*  HCO  + 

H202 

FRATCOfCOR 

34, 

0.10006+13, 

0.00, 

8.000, 

i'M 

RRATCO,COR 

34, 

0.1140E+12, 

0.00, 

6.727, 

,  DIL'JEH,HE 

i'  ' 
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Results 


An  objective  of  the  model  was  to  determine  at  the  outset  if  and  under 
which  conditions  it  Is  possible  to  obtain  a  laminar  opposed  jet  diffusion 
flame  with  a  reaction  zone  of  sufficient  thickness  to  allow  for4detailed 
probing  for  species  profiles.  The  conditions  examined  correspond  to  fairly 
low  stretching  rates  because  of  limitations  in  gas  flow  rates  for  the 
experiment  proposed.  The  question  addressed  is  whether  it  is  possible  to 
obtain  a  sufficient  number  of  sampled  points  to  properly  define  gradients,  and 
even  second  derivatives  in  the  reaction  zone.  This  question  always  arises 
when  flat  flame  data  is  utilized  to  extract  net  rates  of  formation  or 
destruction  of  a  particular  species. 

Figure  3  through  5  show  profiles  of  temperature,  velocity  and  the 
similarity  function  $  ,  of  major  and  of  intermediate  species  for  a  laminar 
opposed  jet  diffusion  flame  with  CO/HjO/^  as  the  fuel  and  0^/^  as  the 
oxidant.  The  stretching  rate  was  3.62  sec-1.  Note  how  density  changes 
Influence  the  axial  velocity  profile  and  the  location  of  the  stagnation  place 
(Figure  3).  The  flame  thickness  is  predicted  to  be  approximately  1  cm,  which 
is  barely  sufficient  to  allow  for  detailed  in  flame  probing.  Figure  5  shows 
that  the  free  radical  profiles  are  present  in  only  a  similarly  very  narrow 
region . 

These  results  prompted  further  predictions  to  be  made  to  determine  how 
the  reaction  zone  thickness  might  be  broadened.  One  approach  is  to  operate 
the  flame  at  subatmospheric  pressure.  Figure  6  show  the  effect  of  decreasing 
pressure  on  the  reaction  zone  thickness  of  the  same  fla*"*  at  the  same 
stretching  rate  of  e  ■  3.62  s-1  . 

It  is  apparent  that  the  reaction  zone  thickness  is  not  greatly  expanded 
until  the  pressure  is  reduced  to  0.2  atmospheres  or  below.  However,  sampling 


Figure  3.  Velocity,  Temperature  and  <p  Profiles  for. 

LOJDF  with  N2  as  Diluent  and  e  -  3.62  s~ 
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and  analysis  problems  are  more  difficult  at  these  low  pressures.  Therefore 
another  approach  to  achieve  thick  reaction  zones  was  attempted. 

Because  helium  has  a  large  diffusion  coefficient  it  was  thought  that 
substitution  of  nitrogbn  by  helium  as  a  diluent  should  achieve  thicker 
reaction  zones.  Figure  7  through  9  show  results  of  predictions  of  a  CO/Hj/C^ 
diffusion  flame  in  helium.  Figure  7  shows  a  reaction  zone  thickness  of  over 
2.5  cm,  while  Figures  8  and  9  indicate  that  at  a  stretching  rate 
e  ■  3.62  s'1  ,  the  species  profiles  do  change  over  a  sufficiently  thick  zone 
to  allow  proper  sampling,  even  at  one  atmosphere. 

Conclusions 

The  laminar  opposed  jet  diffusion  flame  can  be  modeled  in  detail  and  used 
to  corroborate  and  investigate  combustion  kinetic  mechanisms  under  a  wide 
range  of  conditions.  The  ensuing  equations  to  be  solved  involve  stiffness 
through  the  reaction  rate  terms,  very  steep  spatial  gradients  because  of 
diffusion,  and  a  velocity  which  changes  sign  in  the  domain  of  Interest.  These 
equations  can  best  be  solved  numerically  in  a  fully  coupled,  fully  Implicit 
manner,  utilizing  a  modified  discretization  in  the  spatial  domain  that 
approximates  the  equation  within  a  mesh  Interval  rather  than  its  solution. 

This  approach  may  be  relevant  to  many  other  problems  involving  multiple 
reactions,  diffusion  and  convection,  and  future  work  might  be  directed  towards 
Improving  the  discretization  to  allow  better  approximations  for  the  forcing 
function  within  a  mesh  Interval. 


Figure  7.  Velocity,  Temperature  and  Profiles  for  LOJDF 
with  Helium  Diluent  (e  *’3.62  sec"1). 
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Figure  8.  Major  Species  Profiles:  Heliusi  Diluent. 
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AXIAL  DISTANCE,  cm. 


Figure  9 


Free  Radical  Species  Profiles: 
Diluent. 


Helium 


NOMENCLATURE 


Block  tridiagonal  matrix. 

Variable  coefficient  in  equation  (19). 

Variable  coefficient  in  equation  (19). 

Molar  density  (gr-mol/cm3) . 

Genrtal  dependent  variable. 

Heat  capacity  (cal/gr-mol°K). 

Pseudo  binary  diffusion  coeff leant  of  species  A  in  gaseous 
mixture. 

Variable  coefficient  in  equation  ( 19) • 

Forcing  function  evaluated  at  grid  p  and  time  k. 

(see  equation  26). 

Block  vector  of  forcing  functions  (see  equation  (31). 

Mesh  sice  for  modified  discretization  (see  Appendix). 
Thermal  conductivity  of  gaseous  mixture  (cal/cm-sec°K) 
Length  of  the  domain  in  which  numerical  solution  is  sought. 
Number  of  grid  points. 

Molecular  weight  of  mixture. 

Number  of  gases  in  mixture. 

Number  of  chemical  reactions. 

Number  of  species  in  rectlon  set. 
nsp  +  2. 

Pressure  (atm). 

Radial  distance  (cm). 

Rate  of  reaction  j  (gr-mol/cm3-sec). 

Rate  of  formation  of  species  A  (gr-mol/cm3-sec) . 


*i 

t 

T 

v 


v 


W 


1»P“1 


u 

2,pH 


u 

2.P-1 


*A 


Forcing  function  (see  equation  (30))* 

Tine  (sec). 

Temperature  (°K). 

Axial  velocity  (cm/sec). 

Velocity  vector  (ca/sec). 

Radial  component  of  v  (cm/sec). 

Axial  component  of  (ca/sec). 

Weighting  factor  for  modified  discretisation  (see  equation  32) 
and  Appendix). 

Weighting  factor  for  modified  discretisation  (see  equation  (32) 
and  Appendix). 

Weighting  factor  for  modified  discretisation  (see  equation  (33) 
and  Appendix). 

Weighting  factor  for  modified  discretisation  (see  equation  (33) 
and  Appendix). 

Hole  fraction  of  species  A. 

Axial  distance  (cm). 


Greek  Symbols 
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i.P 

i.P 


'i.P 

AC 


AC 


J.P 


Ah, 


As 


Auxiliary  variable  (see  equation  27)). 
Auxiliary  variable  (see  equation  28)). 
Auxiliary  variable  (see  equation  29)). 
Block  vector  of  corrections. 

Correction  to  variable  j  at  point  o. 
Heat  of  reaction  j  (cal/gr-mol) . 
Increment  of  grid. 


e 


Stretching  rate  (sec-*) 


e 


Dimensionless  temperature  ■  T-298  . 

298 

y  Viscosity  of  mixture  (g/cm-sec). 

p  Density  (g/cm3). 

V  Similarity  transformation  (see  equation  (12)). 

Refers  to  distance  from  flame  zone. 

Refers  to  dependent  variable  1. 

Refers  to  grid  point. 

Superscripts 


Subscripts 

m 

l 

p 


k 


Refers  to  time  step 
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APPENDIX 


Development  of  Modified  Discretization 


If  the  function  to  be  obtained  la  viewed  to  approximate  the  solution  of 
second  order  ODE  with  constant  coefficients: 


ai!£  +  bi£+c.  f 

dz2  dz 


then  its  form  will  be 


a.z  ouz 

C  -  Ate  +  A2e  L  +  f 


where  and  may  be  real  and  distinct  or  complex. 


From  Equation  (A2) 


°1Z  alh  <*5h 

Vi  ’  V  •  +  V  •  *  f 


a.z  -a.h  cuz  -ouh 

C  .  -  A.e  1  e  +  A„e  *  e  4  +  f 
p~l  1  Z 


,2  -ouh 


Expanding  C  forward  and  backward  in  a  Taylor  Series,  evaluating  all 
derivatives  and  not  truncating  achieves  the  following  results: 


I-  x-P:I4vV  l8lQh<*ih>  - 


1  **2* 

o^h]  -  —  A2e  [slnh  (ojh)  -  Ojh] 


32 


a  k, 


pt-i 


•T. 


[cosh  (a„h) 


1 


D 

Q 


.  2.  2  .  2.  2 

a«h  ot.h  a.h  a.h 

e  [cosh  (c^h)  -  1 - y~]  e  [cosh  (c^h)  -  1 - ^ — ) 

W2,p-1  "  1  +  sinh  [(aj  -  aj)  h]  +  siiih "[( h] 

(A12) 

b)  Complex  roots: 


«1  *  “r  -  1  «I 


(A13) 


“2  ’  “r  *  1  “I 


The  weighting  functions  are: 


2e  (Mx  +  M2) 
Wl,p+1  "  1  sin  (2oIh) 

®»jh 

2e  *  (Mx  -  M2) 
W1,P-1  “  1  +  sin  C2<xIh) 


and 


(A14) 


(A15) 


CA16) 


-  cos  (Ojh)  [a^h  -  cosh  (a^h)  sin  (a^h)] 
M2  «  sin  (ajh)  [c^h  -  sinh  (o^h)  cos  (Ojh)] 


(A17) 


(A18) 


While 


-aRh 

u  2e  (N  -  N  ) 

2'=~'  1  *  — Hn-rV  T 


W  •  1  •» 

2, p-1  1 


2e  *  (Nx  +  N2) 
sin  Uc^h) 


(  A19) 


( A20) 
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and 


Nj  »  cos  (Ojh)  [a^a^h2  -  sinh  (o^h)  sin  (a^h)]  (A21) 

N2  -  sin  (ajh)  [cosh  (a^h)  cos  (ojh)  -  2-  h2  +  a^h2]  (A22) 

c)  Equal  coots,  a 
The  solution  now  is 

C  -  A^ea*  +  A2z  e®  +  £  (A23) 

and  the  weighting  functions  for  Equations  (32)  and  (33)  become 

W,  ^  «  1  -  e  -(*[sinh(  oi»)  -  cosh  (<*)  -  cfc  -  1]  (A24) 

l.P+l 

W,  ,  -  1  +  •*  [alnh(cfc)  -  cosh  (<*)-<*+  l]  (A25) 

1, p-l 

2  2 

W.  -  1  -  e-ah  [cosh(o4i)  +  sinh(  <*)  -  ~~  -  ah  -  1]  (A26) 

2,  p+1  2 

2  2 

W,  ,  -  1  -  e®*1  [cosh((*)  -  sinh(  oh)  -  -2~-  +  ah  -  U  (A27) 

l,p-l  i. 

Thus  it  can  be  seen  that  this  modified  finite  difference  formulation  is  exact, 
with  no  truncation  error,  if  the  general  solution  for  the  real  problem  behaves 
like  that  for  linear  ODE' s  locally.  The  roots  <»j  and  are  calculated  from 
the  actual  homogeneous  equation  at  position  P.  The  particular  integral  is 
also  taken  to  be  a  constant  locally.  Since  the  equations  for  the  opposed  jet 
diffusion  flame  might  fit  into  this  category  (compare  Equations  A1  and  19)  it 
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would  appear  that  the  new  fornulation  might  allow  a  drastic  reduction  In  the 
number  of  grid  points. 

Simple  Test  for  Comparison  of  Standard  and  Modified  Discretisation 

For  the  solution  of  simple  ODE's  with  constant  coefficients,  with  II  grid 
points  modified  discretization  was  exact  to  with  seven  figures  while  standard 
discretization  was  good  to  with  2  to  4  figures.  For  the  equation: 


BC:  z  -  -  1.5  C  -  1.0 

z  *  +  1.5  C  ■  0.0 


the  modified  discretization  was  stable  using  from  5  to  95  grid  points.  The 
standard  discretization  was  unstable,  with  oscillations  at  the  boundaries  for 
less  than  35  grid  points  and  thus  with  total  loss  of  accuracy  at  the 
boundary.  However,  the  modified  discretization,  although  stable  at  the 
boundaries,  was  inferior  to  standard  discretization  in  determing  the  peak 
value  of  C.  This  was  doubtless  due  to  the  assumption  of  a  constant  forcing 
function  over  a  mesh  interval.  Further  improvement  might  be  achieved  by 
allowing  for  a  exponential  forcing  function  over  a  mesh  interval  and  thus 
deriving  a  new  formulation  for  discretization. 
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Abstract 

In  order  to  gain  a  full  understanding  of  the  basis  of  chemical  reactivity, 
it  is  necessary  to  know  how  individual  molecular  processes  influence  or  determine 
the  rates  of  observed  chemical  reactions.  A  widely  applicable  model  of  chemical 
kinetic  processes  in  molecular  gases  is  to  treat  them  as  a  sequence  of  collision- 
induced  transitions  between  the  quantised  energy  levels  of  the  molecules.  Using 
this  model,  and  assuming  that  the  rate  constants  for  the  transitions  between 
levels  are  known  or  can  be  found,  ehe  prediction  of  the  kinetic  behavior  requires 
the  solution  of  a  set  of  differential  equations.  The  tine-dependent  populations 
of  the  individual  energy  levels  of  the  molecules  can  be  calculated  by  integrating 
the  system  of  chemical  kinetic  ordinary  differential  equations  ("master  equation") 
governing  those  populations.  When  the  populations  are  known,  the  other  time- 
dependent  properties  of  the  reaction  system  can  be  calculated,  and  the  influence 
of  individual  molecular  processes  can  be  analysed. 

In  recent  theoretical  studies,  the  H,  molecule  has  played  an  important 
role.  A  major  reason  for  this  is  that  H,  has  only  about  370  internal  (v,J) 
levels,  a  number  which  is  small  enough  for  the  master  equation  to  be  solved 
directly  by  modern  numerical  techniques.  The  sise  of  the  problem  can  be 
further  reduced  by  confining  attention  to,  e.g. ,  the  176  levels  of  para-H, . 
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Two  of  the  aoat  basic  chemical  kin* tic  process**  srs  ths  collision- 

% 

induced  vibrational  excitation,  and  the  coll is ion- induced  dissociation,  of 
simple  nolecules.  We  have  studied  these  processes  in  para-H,  with  8s  as 
collision  partner.  The  8,-Ha  system  was  chosen  because  very  good  interaction 
potentials  are  available.  The  calculations  simulated  shock  wave  experiments 
in  which  the  translational  temperature  of  the  gas  is  suddenly  raised;  the  popu¬ 
lations  of  the  levels  then  relax  towards  equilibrium.  The  systea  ot  differential 
equations  which  oust  be  solved  is  very  stiff.  Transition  rate  constants  among 
the  various  bound  levels  can  differ  by  fifteen  orders  of  magnitude,  and  some  of 
the  rate  constants  for  the  dissociative  processes  are  even  smaller  than  say  of 
those  for  transitions  among  the  bound  levels.  Kxcept  at  high  temperatures,  the 
most  important  processes  are  those  in  which  the  quantum  numbers  v  and  J  change 
by  only  small  amounts.  The  rate  constant  matrix  can  therefore  be  very  sparse. 

■samples  of  these  calculations  will  be  presented  and  discussed.  Among  the 

factors  which  have  bean  investigated  and  elucidated  ares:  this  mechanism  of 

vibrational  relaxation,  especially  the  relative  importance  of  pure  vibrational 

and  simultaneous  vibration-rotation  transitions;  the  rslative  importance  of 

i 

rotational  and  vibrational  energy  in  the  dissociation  reaction;  the  contribution 
of  collision-induced  dissociation  directly  out  of  relatively  low-lying  energy 
levels;  departures  from  a  Boltzmann  distribution  among  molecular  energy  levels 
during  pseudo-steady  dissociation;  the  factors  governing  the  observed  "anomalously" 
low  temperature  dependence  of  the  dissociation  rate;  the  possibility  of  deviations 
from  a  linear  mixture  rate  law  for  the  overall  dissociation  reaction. 


DYNAMICS  OF  FIXED  BED  ADSORBERS 

M.Q.Dias, J. C. Lopes, C. A. Costa  and  A. E. Rodrigues* 

Modelling  of  fixed  bed  adsorption  is  described  by  two  different 
approaches : staged  and  differential. 

Considering  first  the  staged  approach  (column  viewed  as  a  series 
of  perfectly  mixed  sorbers)  we  start  with  the  study  of  adsorption 
in  a  CSTR.  Even  for  this  simple  case  highly  stiff  systems  occur, 
with  film  mass  transfer  resistance ,and  provided  the  isotherm  is 
nonlinear. 

Algorithms  for  the  integration  of  systems  of  ODEs  (Michel sen, Geaurb) 
are  compared . 

The  differential  approach  leads  to  a  system  of  PDEs; after  using 
collocation  methods  we  obtain  again  stiff  systems. Difficulties 
associated  with  handling  this  problem  is  discussed  in  detail.* 
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Zt  la  tha  ala  ef  thla  oaaaunlcatlea  ta  Hat  aoaa  af  tha  aora  aoware  ahorteealaga  af  cur¬ 
rently  avallabla  atlff  oaeputatlca  eedaa  aa  they  Kara  baan  eollaotad  through  *laaaaalaaa 
with  tha  Hod  uaara*  af  aueh  aoftw ara.  Thaaa  eoaplalata  ara,  howcwcr,  foraulatad  la  taraa 
a*  thajr  ara  understandable  ta  aathaaatlelaaa,  that  la  ta  tha  ■produoere'  af  integration 
algorithm.  Saaa  suggestions  ara  glwea  aa  haa  thaaa  daflalanalaa  aajr  ba  ewsraews  la  tha 
future,  aad  shore  apaa  raaaarah  rial da  aaa  a till  ha  found. 


i.  nmtooocTioo 


■awing  a  haakgrauad  la  Ileotrleal  Engineering, 
atlff  eaaputatlan  la  certainly  nat  at  tha  warjr 
caatar  af  ay  aolaatlfle  raaaarah  actlwltlaa.  X 
hawa  aawar  dawalapad  an  integrating  algarltha  af 
ay  awn.  and,  If  ay  predicting  la  aarraot,  X  ah all 
navar  da  aa. 

■awing  read  thla  atataaaat  af  alaa,  yaa  aay  aak 
yauraalf  what  thaa  la  tha  raaaaa  far  aa  ta  alt 
dawn  at  tha  taat  editor  aad  ta  tjrpa  la  thla  com 
aualaatlan.  In  fact,  you  aay  ba  raalndad  af  tha 
aid  Joke  aanearaing  tha  fallaw  wha  aaaa  catered 
tha  anployaant  office  af  a  larger  eeapany.  lakad 
far  hla  desire,  ba  answered  that  he  had  aaaa  be¬ 
cause  ba  had  read  la  tha  aawapapar  abeut  thla  new 
opening  far  tha  peat  of  aa  engineer.  Tha  paraea  la 
charge  of  the  natter  atarted  ta  aak  hla  questions 
of  all  aorta  ta  figure  out  what  lowal  af  knowledge 
thla  fallaw  bad  acquired,  and  it  turned  out  aaaa 
that  ha  was  hardly  able  ta  answer  the  slaplest 
questions,  finally,  tha  eepleyaant  aanager  turned 
aad  and  askad  his  what  had  aada  hla  thinking  that 
he  night  be  the  appropriate  parson  ror  thla  Jab, 
So,  the  (rather  shy)  wlaltor  told  hla  gently  that 
he  Just  had  eoao  ta  tall  thaa  that  they  should  nat 
count  an  hla.  Howewar,  X  insist  that  also  this  la 
aat  the  reason  far  ay  writing. 

Originally  coning  free  tha  application's  side 
(doweleplag  emulation  software  far  the  Swlsa 
aaahlaa  tool  industry),  X  aawad  aora  aad  aero  away 
free  tha  Had  user*  applications,  and  beeaas  man- 
whUe  a  'teal  aakar*,  that  lat  a  paraea  who 
dawalapa  software  (la  parti eulari  nodal ling  aad 
emulation  software)  for  ether  persona '  needs.  Ky 
awa  fluid  of  raaaarah  thaaa  days  la  basically  la 
Caaputer  Sale aaa.  By  these  aaaaa,  X  understand  w 
Jab  aa  ta  be  kind  af  aa  'interpreter*  between  tha 


■aad  uaara*  of  the  software  aa  the  ana  aide,  that 
lat  paapla  who  base  definite  needs  but  who  are 
poorly  trained  to  express  their  needs  la  taraa 
condensed  enough  to  aaka  thaa  easily  under¬ 
standable  ta  aatheeatlolana;  aad  between  the 
■producers*  or  algorithm  (mong  others:  integra¬ 
tion  algorithm)  on  tha  other  side. 

In  this  Bonaunloatloa,  X  shall  try  to  suamrlso  a 
few  eeeplalnta  raised  by  aeae  or  ay  uaara  aa  com 
ooralag  atlff  eoaputatloa  algorithm  and  oodes. 
Howewar,  Z  shall  try  to  raforaulata  them  can- 
plaints  la  term  tdileh  should  be  understandable  to 
the  producers  ef  them  algorithm  whleb  X  realise 
shall  bo  present  at  Park  city.  That  1st  ay  earn 
aunleatlen  shall  basically  pom  questions  rather 
thaa  to  present  answers.  Zt  is  ay  alneere  hope 
that  am  or  the  other  af  tha  *  algarltha  producers' 
my  find  those  questions  of  sufficient  interest 
aad  generality  to  be  prepared  to  looking  for 
aaswera,  that  Is:  to  dawolop  asw  algorithm  or 
amad  existing  algorithm  whloh  X  could  thee  Inte¬ 
grate  into  wr  emulation  software  so  that,  la  the 
final  run,  they  would  satisfy  the  needs  of  ay 
alaulatloa  users. 


x.  Dzscotrrxjrom  ■amdi.xmo 


Xt  happens  frequently  la  engineering  applications 
that  alaulatloa  preblaaa  ara  af  a  discontinuous 
nature.  Xa  term  af  a  mtheeatl slant  glrea  the 
stats  spaas  representation  of  a  system  (that  1st  a 
set  of  first  ardor  OOP's) 

X  *  Kx*t) 

tsgathsr  with  a  sat  of  Initial  aoadltleaot 
Ktstq)  a  Xp 
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to  fora  m  initial  nlm  proU.no,  and  tsgotber 
with  •  final  tlaa 
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lypiMl  nxaopioa  of  Hamiioii  ilawU  ami 

a)  la  won h an leal  engineering! 

•  friction  phaneoana 

•  loeaa 

h)  la  aloetrleal  engineerings 

•  diodes 

•  thyristors 

•  aay  oaabinal  analog  aal  digital  airaalt ry 

a)  la  ahaalcal  engineering: 

-  charging  aal  discharging  of  batab  raaators 

Ha  aaa  distinguish  basically  batwoan  two  different 
typos  of  aiacoatlaultioai 

a)  ilaeontinultlaa  of  wblab  wa  kaaw  tho  tlaa  whaa 
they  am  oxpoetod  to  bappan.  la  a  typical 
aaaapla  of  tbla  typo  of  dlaeontiaulty,  wo  any 
aantloc  tho  output  volt  ago  of  a  square  wave 
gaoorntar .  Saab  tlaa,  tho  volt ago  awltoboa 
fraa  negative  to  positive  value  or  vlce-verse, 
a  discontinuity  taboo  place.  Tbo  tlaa  In- 
atanaaa,  wbon  tboao  diaeaatlnuitloa  am  at* 
pactod  to  take  plaoo,  aro  praalaaly  baawa 
beforehand.  Thaaa  dlaoaatlnultloa  am  la  oiao- 
latloa  usually  mf erred  to  an  *Uao  areata*. 
Tlaa  erenta  ere  aabadulad  area to  la  tba  aaaaa 
that  tba  tlaa  laataaaaa  of  wbon  tbo  dleoeeti- 
aulty  in  to  take  plaoo  any  bo  eallaetad  lata  a 
■aaloodar  of  ereata*. 

b)  dlaoontlnultioa  or  wblab  wa  do  not  baforabaod 
know  tho  tlaa  whan  they  are  anpaatad  to  hap¬ 
pen.  inatead,  wa  know  tba  eaadltlan  wad or 
wblab  tho  dlaeontiaulty  takes  plaaa.  a.g.  one 
atata  variable  (xi)  creasing  a  prescribed 
lorel  into  pcaltlra  direction.  la  a  typical 
osaapla  of  tbla  typo  or  dlaeontiaulty,  wo  any 
aaotloa  tba  output  voltage  ef  a  rectifier 
circuit.  Ham,  wo  do  not  know  when  tbo  output 
voltage  la  going  to  bava  a  dlaeontiaulty  (la 
Ita  first  tine  derivative).  Ha  just  know  that, 
each  tlaa  tba  input  voltage  creases  through 
■aro  in  either  direction,  the  output  voltage 
has  a  break.  Thaaa  dlaoontlnultioa  are  In 
emulation  uaualiy  referred  to  an  *atata 
events*.  Par  atata  events,  no  scheduling  la 
possible.  Instead,  we  aaad  a  an c hen 1  so  to  de¬ 
scribe  the  condition  under  which  the  event  la 
going  to  happen.  Tbla  la  usually  referred  to 
as  "atata  condition*. 

Xt  aakaa  sense  to  distinguish  between  thaaa  two 
types  of  discontinuities  for  two  rooooooi 

1)  Tba  user  of  the  soda  requires  two  different 
sac  ban tan a  to  deeorlbe  tbo  discontinuities  to 
tbo  pragma. 


aachanlans  to  handle  than.  Tlaa  events  nay  be 
handled  alaply  by  inspection  of  tho  calendar 
of  events  for  the  next  aabadulad  event  tins. 
Whan  this  assent  approaches,  the  step  also 
aunt  ba  redwood  to  bit  the  event  tlaa  pre¬ 
cisely,  er  the  algorltha  swat  interpolate  book 
to  the  lust  passed  event  tins,  daps ad lag  on 
tho  algorltha  in  use.  guts  events,  on  tbo 
other  hand,  oust  be  handled  by  either  itera¬ 
tion  or  interpolation  (dapoadlag  an  tbo  algo- 
rltha). 

Unfortunately,  until  vary  recently,  none  of  tba 
existing  codes  far  nuaerlcal  integration  provided 
for  appropriate  dlsoaotlnulty  handling.  When  I 
aaatlanad  tbla  problaa  to  linn  Hladaarsh  during 
tba  Orbaaa  tCN/SICUnH  Conference  on  guaerlcal 
Ordinary  Differential  tquatloaa  (three  years  ago), 
ho  answered  that  this  was  aemly  a  trivial  problaa 
which  should  ba  loft  to  the  and  user  (to  ho 
aptlaally  adapted  to  hla  personal  needs)  and 
should  certainly  Ml  ba  of  way  concern  to  the 
auaortoal  nathanatlolan.  X  did  not  agree  upon  this 
judgmat  at  that  Una,  and  X  definitely  da  ant 
agree  tn  it  non.  bdaaana  for  thin  am  aanyfeldi 


I)  The  anna  r  teal  aothaaeUelaa  a  easily  thinks 
that,  given  a  particular  algerltka,  everything 
la  aald  and  elear.  however,  this  la  Ml  the 
aaaa  la  reality  far  reasons  of  oenounl cation 
probleas.  The  and  user  la,  la  general,  act 
able  to  understand  an  lntogrnuoa  algorltha 
■uffloloatly  wall  to  ho  able  tn  oodo  it  into  o 
properly  os coating  progrsn  by  hlnoolf.  Tbla 
holds  equally  true  for  dieeootlnulty  handling. 
Conoornlag  tho  lntogratlon  algorltha,  the 
an  tboao  tleal  otUtudo  woo  orlglaally  also  that 
ooding  of  tba  progrsn  would  be  baoleelly  la 
tba  uaor'o  reepoelblllty,  while  it  boo  mao- 
while  boon  rohlitad  that  preout  standardised 
oodoa  aro  euperlor  in  may  mapeets,  avea- 
t hough  thorn  am  still  eons  people  eround  to 
toll  tbla  tbo  *veewwn  eloooor*  approeoh 
(Oeoo  Oolub).  X  suggest  that  tho  haodllng  of 
dleeoatlaultloo  lo  Just  a  little  Jung or 
problaa,  eng  that,  on  tho  long  run,  also  bom 
standardised  oodso  shell  reploos  boon  tailored 
aoftwom. 

t)  Xf  you  look  into  tbo  work  dona  by  T.  t.  Hull 
at  Tomato,  it  should  boaoao  aloor  that  am 
has  no  ohanoa  whatsoever  to  eonpom  Integra- 
Uoa  aienrithna  with  each  other.  Hhat  am  em 
do,  however,  is  to  ooapom  tbo  aptitude  of 
different  integration  Mdtt  to  solve  o  par¬ 
ticular  given  application  problaa.  Hopefully, 
om  is  lueky  enough  to  ho  Ohio  to  extend  tho 
exporleneea  gained  froo  satire  cote  of 
problem  to  O  elaaalflcatlan  of  cpplleaUona. 
Xt  should  then  bacons  clear  which  algorltha  la 
boat  for  any  particular  practical  appllootloa 
without  being  reread  to  try  than  oil  out. 
Hull's  moults  indicate  that  the  stop  fron  tho 
integration  algorltha  oooo  given  to  tbo  inte¬ 
gration  oodo  It  by  os  mono  of  o  trivial  ao- 
ture.  Xa  fast,  acre  eonputatlea  tine  to  coed 
by  ttd  'dirty*  eurroundlngt  than  by  tba  into* 
gratlea  olgarlthn  itself.  Again,  aim  thin 
dgpAAnn  to  the  prohlm  of  dinoonblnnlty 


t)  Tho  nlgsrltbn  roquirm  ton  dlffumnt 


handling  u  wall. 

3)  Xt  li  not  econoeleal  at  all  to  develop  larger 
ploooa  of  software  for  each  application  se¬ 
parately.  On  tha  contrary,  wo  should  oon- 
oontrata  on  detsroinlng  what  largo  olaaaaa  of 
application  problana  have  la  eoaooa,  attract 
this  information,  and  proa Ida  for  a  pro  gran 
which  handles  all  that  In  a  standardised 
aannor.  This  la  Una  officiant,  no  nap  ef¬ 
ficient,  and  nuch  safer  as  tha  aaeunt  af  soft¬ 
ware  loft  to  ho  coded  bp  the  end  woor  la  elal- 
altod  while  obviously  nuch  sore  earn  sad  on- 
portness  can  flow  into  the  design  and  produc¬ 
tion  of  the  standardized  part  of  the  software. 
Xt  la  hare,  whore  *alaulatlon  software*  none a 
Into  the  gane.  Definltelp,  dlaeoatlnuitp  hand¬ 
ling  belongs  to  tha  part  of  the  code  which 
should  be  standardised. 

To  conclude  these  considerations,  lot  aa  propose 
scan  very  concrete  atapa  towards  a  (according  to 
ap  view  satisfactory)  solution.  Those  aaong  pea, 
who  are  involved  la  the  business  of  producing 
Integration  codas  rather  than  Integration  algo¬ 
rithms,  shall  certainly  be  aware  of  tha  proposals 
raised  bp  Alec  Hindoo rah  as  eaacornlng  a 
standardised  user  latorfaee  far  OOg  solvers 
( 00 C PICK)  [lb).  This  la  precisely  shore  wo  aught 
to  go.  Xt  la  evident  that  X  cannot  knew  la  advance 
under  all  dreuastanoos  which  integration  cede 
shall  be  optiaallp  suited  for  ap  particular  ap¬ 
plication.  It  should,  thus,  be  such  that  X  can 
code  ap  application  software  entirely  Utfgggfltfg&l 
of  the  001  solver.  Ideally  soon,  X  would  llko  ta 
be  able  to  replaeo  aap  OBB  salvor  bp  sap  other  OM 
solver  bp  slaplp  replacing  ana  subroutine  none  bp 
another  subroutine  naan  without  being  forced  ta 
change  a  single  bit  of  m  application  prog rsg 
beyond.  In  fact,  X  would  want  to  aalatala  a 
library  or  integration  oedes  to  have  a  * reus dp 
against  all  diseases*,  la  additional  advantage  of 
this  approach  is  that  I  aap  easily  update  ap  OOg 
solver  library  when  new  releases  beooao  available 
an  there  are  no  aide  effects  to  be  espected  free 
slaplp  replacing  the  old  subroutine  bp  its  aodl- 
flcd  version.  However,  this  also  naans  that  X 
should  not  bo  forood  to  change  a  single  lino  with¬ 
in  the  OOt  solver  for  any  particular  application. 
Xt  la  now  vary  easily  shown  that,  when  I  try  to 
graft  the  discontinuity  handling  upon  the  integra¬ 
tion  cede  (which  Jg  possible,  and  which  X  have 
dona  in  ay  slaulatloa  software  GUM  [»,J]  for 
preeiaely  the  above  aantlonsd  reasons),  X  obtain 
Inefficient  code.  Per  this  reason,  although  X 
fully  support  ilan  Hlndaarsh's  idea  concerning  a 
standardised  interface  far  OOt  solvers,  I.  do  not 
agree  to  his  standard  proposal.  I  feel  strongly 
about  the  need  for  ear,  see  i«  the  standard  proposal 
by  adding  on  to  it  aa  appropriate  description  of 
conditional  termination  criteria  (discontinuity 
functions)  as  it  shall  be  presented  la  due  course. 
Xn  addition,  the  standard  should  alao  be  expand sd 
la  a  further  sense.  If  X  currently  want  to  aala¬ 
tala  a  library  of  OOt  aolvers,  X  shall  nest  cer¬ 
tainly  need  a  linear  spates  solver  in  the  aajorlty 
of  then.  If  this  (lower  and)  latorfaee  la  not 
standardised;  toe,  X  have  to  aalatala  any  number 
of  basically  identical  linear  oystea  aolvers  in  ap 
OOg  library,  far  thla  rootle,  it  would  aaba  sense 


ta  otoadordlse  also  this  lower  end  of  tho  OOt 
ooda.  Different  linear  aystea  solvers  nay  then  re¬ 
side  in  a  (possibly  separata)  library  (a.g. 
general  U1  and  a  pa  roe  LSI)  out  of  which  X  nay 
select  whatever  scans  appropriate  to  go  with  what¬ 
ever  OOg  solver  X  want  ta  use. 

Tha  basic  preblm  here  lo  that  numerical  nethema- 
tlelaas  (that  1st  the  producers  of  the  integration 
algorithm)  are  not  noooooarlly  equally  well 
trained  for  ooaputer  sc lease,  however,  the  above 
aaatleaod  w-nsldsretieao  are  heal sally  thoao  of  a 
ooaputer  select 1st,  and  not  of  a  nathcnatlclaa, 
and  It  la  sens  tins  a  bard  to  convince  aattte- 
aatielaaa  of  tho  fruitfulness  of  aueh  ooanl do  ra¬ 
tions. 

Whan  X  asked  o.  Mannar  after  his  presentation  of  a 
newly  developed  A- oontr active  algorltha  (that  la 
--  la  tarns  of  Oarnuad  Dahlqulat  ••  a  G-etable 
algorltha.  If  X  understood  Mannar  correctly),  a 
presentation  which  waa  given  during  the  hutia- 
hauacr  Syapoalua  in  Zurich  [21],  whether  ho  had 
already  produced  any  eaeeutable  code  far  bin  alps 
rltha,  be  looked  at  as  as  you  aap  look  at  a  very 
strange  bird  and  answer od  that  bin  work  wan  purely 
theoretical,  and  that  the  Job  of  ending  would  de¬ 
finitely  have  to  be  a onions  elan's  task.  X,  how¬ 
ever,  can  assure  you  that  the  end  use.  is  cer¬ 
tainly  neJL  willing  to  try  his  hands  at  aueh  an  ad¬ 
venture  because  he  la  (1)  not  able  ta  da  It,  end 
(2)  not  able  to  Judge  beforehand  whether  thin  now 
algorltha  will  got  bia  anywhere  or  ant.  Xt  baa  al¬ 
ready  tan  often  happened  (also  tn  apaolft)  that  a 
goad  looking  now  algorltha  turned  out  to  be  a  oam- 
pleto  failure  after  It  bad  been  ceded  lata  a  pro- 
gran.  The  efrort  apant  on  coding  thla  algorltha 
was  tremendous,  and  It  baeaoo  afterwards  never 
el ear  whether  the  problan  waa  really  with  tho 
algorltha  or  Just  with  the  eedel 

Even  P.  Nenrial  (who  lo  known  for  hla  aye  pa  thy 
with  *praatieal*  solutions  to  *roal  world* 
preblans  as  opposed  to  ‘Ivory  tower*  solutions  ta 
■green  grass*  problana),  whoa  X  asked  hla  a  couple 
of  years  ago  whether  bo  would  agree  to  Join  the 
oonaantlng  cnnnlttee  for  op  fhO  thesis  which  X  was 
to  write  on  *Coablnod  Coatlnuoua/Dlscreto  Syeten 
Ilaulatloa*  (9),  answered  that  he  did  not  know 
anything  about  slaulatloa  but  that  ho  waa  cer¬ 
tainly  willing  to  learn  sane thing  about.  X  then 
told  bln  that  thla  waa  beside  tho  point  la  that  X 
was  sure  that  be  know  a  lot  about  emulation.  The 
problan  was  alaply  that  ho  did  not  know  that  bo 
know  seas U lag  about  I  This  ladaod  Xa  a  severe 
problan  In  that  It  ladies too  that  the  average 
netheoatlclaa,  even  being  a  specialist  la 
auaorleal  Integration,  does  act  scan  the  litera¬ 
ture  for  articles  on  ’emulation*,  even  though 
these  artleloo  could  be  aa  1 sport ant  to  hla  work 
as  any  contribution  on  *auaorlonl  Integration*. 

Cealng  back  to  ap  former  Issue  on  discontinuity 
handling*  What  ban  happened  siaoo  tho  Orbonn 
aoetlagf  X  waa  glad  to  realise  that  there  were  at 
least  a  few  aa  theme tisisas  around  who  took  ap  earn- 
nsnto  aoriously  enough  to  spend  seme  thoughta  on 
them  and  think  of  none  r madias.  In  foot,  asms  ra 
suite  nay  already  ho  omnarlnad  now. 


/ 


1)  Far  aoa-*tlff  probloaa,  Uia  UmatiMU; 
handling  pro  bias  had  already  baaa  aolvad  prior 
to  tha  Urban*  oeetlng  by  aooa  people  Ilk* 
Alan  Fritakar  [10]  and  ay  self  [0]  lit  a  fairly 
general  nay.  Applying  an  IK-elgorlthe,  ve  Juat 
ban  to  aaka  aura  that  th*  dlaeontlaulty  taka* 
plan*  at  tM  and  af  an  integration  atop.  Tina 
ovaata  ara  handlad  by  alaply  reducing  th*  atop 
alt*  if  th*  aoat  mtt  la  ahortly  aha  ad.  Stata 
ovaata  ara  handlad  by  Iterating  bask  to  th* 
unknown  avaat  tin*  by  aay  available  aathed. 
Fritakar  uaaa  bi*aeetloa  ( 10],  aharaaa  X  r*> 
aartod  t*  lava  ran  haratta'  latarpalatma  151. 
Far  obviau*  auaarlaal  reason*,  It  la  lapartaat 
POX,  ta  eed*  tha  diaeaatiaulty  Itaair  la  tha 
ODE  aat  but  only  th*  atata  eaadltlea  (a.g.  by 
a* ana  of  aandltlaaal  teralnatloa  er It aria) . 
Tha  dlaeontlaulty  ltaalf  la  than  aapraaaad  by 
context  switching  during  th*  aaaautlea  of  th* 
avaat  (aft or  aaaautlea  of  tha  avaat,  another 
aat  of  ODE 'a  bacaoaa  active).  A  aeaaukat  aero 
aathaaatleal  view  af  thla  proaadara  aaa  be 
found  froo  Hannah ardt  (101. 

2)  Far  atlff  problana,  oaa  uaually  uanta  to  apply 
aultl-atap  latagratloa,  for  uhleh  th*  atop 
alto  adjuataant  at  laaat  areata*  a  eartaia 
aneunt  of  avarhaad.  Tha  nou  ooaonn  approach  la 
to  aalntaln  two  independent  eleeka,  th* 

external  alaulatlOB  Clock  and  th*  Internal 
integration  eleek.  Tha  latagratloa  proeeeda 
ulth  optlnlxad  atop  ala*  and  order,  uhereaa 
th*  ayaahraaiaatloa  ulth  th*  alaulatlen  cloak 
la  dona  by  Interpolating  back  ualng  th* 
■erdaleek  vector.  Thla  aethodology  nay  ala*  b* 
applied  t*  dlaeontlaulty  handling  if  tha  atata 
ee editions  *r*  foruulatod  a*  an  adjetnt  aat  *f 
dlaooatlBulty  function* 

ulth  th*  asaaiag  that  th*  alaulatl*a  run  ter- 
nlaata*  at  althar  th*  final  Una  t »  or  uh*n 
th*  rirat  af  th*  g,  function*  area***  through 
a*ro  m  either  diraetioa,  *h*t*v*r  eenaa 
flrat.  Aeeordlng  ta  ay  hneuledg*,  u*  ev*  thla 
fernulatlon  to  Mika  Carver  (1). 

J)  TV*  of  the  available  CEAP-codoe  (on*  by 
Mika  Carver  (]],  and  th*  eth*r  by  Eahanar 
(IS])  hav*  aeanwhil*  been  upgraded  t*  cental* 
a  dlaeontlaulty  handling  nechanlan.  At  leaat 
far  th*  Eahanar  lnpleneatatloa  (uhleh  X  eon- 
aldor  t*  b*  th*  beat  ef  th*  currently 
available  CEAP-eode*  —  it  differ*  fra*  th* 
Hlndnarah  lnplanantatloa  la  that  th*  forear 
D1FSUB  aubroutin*  ha*  bee*  nodularlaed  lat* 
about  20  anallar  aubroutin**  uhleh  ar*  no* 
nueh  oaaler  undaratandable  and  avoid  all  thoa* 
■dirty*  GOTO  atatenanta  pointing  baekuard  In 
*od*l ) ,  the  dlaeontlaulty  aaehaalan  *****  to 
hav*  b**n  partly  triggered  by  ny  eonnaata  at 
Urban*,  la  that  Haeftyaaa  (uho  uaa  taking  part 
la  th*a*  dlaeuaalana  at  Drbaan)  produced 
ahortly  after  that  a*«tlag  a  nau  v*ral*n  of 
th*  Eahanar  **d*  uhleh  aee  all***  t*  *p**lfy 
a*  adjoint  aat  af  dlaoaatlaulty  function*  by 
uaing  pr**l**ly  th*  naebanlan  adv*rtla«d 


0)  X  night  vant  ta  auggeat  th*  Introduetloa  of  aa 
additional  flag  far  Indication  whether  really 
all  eroaalnga  ar*  to  b*  detect ad  or  uh*th*r 
only  poaltiv*  or  only  negative  eroaalnga  are 
laportant.  Thla  la  net  really  eaaeatlal,  but 
it  la  uaaful  in  naay  applleatlras  to  faraulat* 
hyataraala  af facta  (*.g.  a  heating  ay at  an  la 
aultehad  on  whan  th*  teaperatur*  fall*  b*l*w 
10  degree*  oentlgrad,  uhll*  It  1*  aultebod  off 
•nly  after  th*  taaparatur*  r*ach*d  21  degree* 
oentlgrad  —  a*  to*  frequent  awltehlng  aay 
daaage  th*  awltehlng  naebanlan).  by  aa*  af  th* 
abov*  Mentioned  flag,  a  lat  *f  wane— nnary 
aantaxt  awltehlng  aaa  b*  aval  dad  uhleh  oak— 
th*  uaar  prograna  ahortar. 

S)  Unfortunately ,  th*  abov*  nentlonad  aeohanlK 
data  net  really  aolva  all  problana  yet.  Th* 
reaaea  far  thla  la  aa  follow*!  After  a  die* 
continuity  teak  pine*,  th*  latagratloa  a**d* 
to  b*  reatartad.  In  eaaa  of  the  GEAh-eod**, 
thla  a* ana  that  th*  algoritha  baa  to  atart 
again  at  an  order  of  on*.  Xf  dlaeoatlauitlaa 
occur  at  frequent  rat**,  th*  integration  algo* 
rltha  need*  to  bo  raatarted  again  and  again. 
Xa  thin  way,  an*  and*  *aally  up  by  having  aa 
eatranaly  laafflelMt  lnplanantatloa  of  th* 
trapoaoldnl  rule,  aa  higher  ardor*  gat  a* 
ahane*  to  build  upl 

0)  Xt  1*  quit*  frequent  In  engineering  appllen- 
tione  that  th*  aeeuraey  r*qulr*n*ata  ar*  net 
very  aav*r*  (*.g.  .0001).  Than,  an  *ffi*i*nt 
law  order  algoritha  nay  d*  a  bettor  Job  on  th* 
problea. 

T)  Thin  waa  r earned  by  Bmflhard  uho  developed  a 
new  low  erder  end*  for  ntirf  integration  uhleh 
leak*  vary  proalalng  (to).  Far  aueh  an  algo* 
rltha,  al no  th*  dlaeontlaulty  handling  banannn 
oaaler.  (X  have,  however,  not  yot  found  th* 
tin*  t«  try  ny  own  hand*  at  thla  oad*,  and  a* 
X  cannot  give  aay  final  Judgaont  yet.) 

I)  Xf  higher  aeeuraey  r*qulr«ont*  ar*  laportant, 
a  higher  erder  algoritha  ban  lta  advantage*.  A 
typical  engineering  application  for  thla  would 
be  the  emulation  of  *  eoablned  analog  end 
digital  circuitry  containing  eoacry  eleaente 
(flip  flopa).  Xa  nueh  application*,  it  la 
estreaely  laportant  to  know  whether  aplkca  ar* 
around,  and  what  th*  aaslaun  tranaient 
voltage*  in  non*  part*  of  th*  analog  circuit 
ar*.  Th*  answer  t*  th***  q**atl*a*  1*  very 
sensitive  to  p*rMt*r  variation*  and  ala*  t* 
event  lining.  For  thla  r**a*a,  th*  cyst  an 
uaually  oust  b*  emulated  with  •  relative  ee- 
ouraey  ef  10  ..  10  . 

9)  After  X  n*ntlon*d  this  problea  to  0U1  Gear, 
ho  realised  that  hi*  algoritha  oauld  b* 
substantially  iapr*v*d  If  th*  *w*rnlag  up* 
period  could  be  aade  nor*  efficient,  that  la, 
if  we  eaa  avoid  to  restart  after  din* 
ooatlnuitlM  at  order  on*.  For  thla  purp***, 
be  developed  in  th*  a* an  tin*  SS-atarters  for 
GEAR-eodes  (1J].  Although  X  hav*  a*t  yet  found 
the  tin*  t*  iaplaaent  *uoh  aa  algoritha  par* 
•easily,  X  «a  fully  eaavlaaad  that  thin  naend 
aaat  shall  asks  th*  **d*  aubatanUally  twMr 
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whee  frequent  discontinuities  occur . 

10)  X  would  definitely  reoemond  to  the  LooUoooo 
group  (Mac Hyman)  to  eonolder  the  looorporotioo 
of  Mob  an  algor ltha  into  tholr  code. 

Xn  foot.  It  were  these  reactions  to  W  ooooenta 
raised  at  Orbaaa  which  wore  basically  responsible 
for  encouraging  ae  to  elt  down  now  and  to  write 
this  ooaaunieatloa  oontalalag  a  good  oollootloa  of 
uy  eurreot  coaplalnta. 

tree  if  a  good  so  cunt  of  progress  has  bead 
achieved  aloes  1979i  the  question  of  discontinuity 
handling  la  by  no  aeaae  settled  yet.  To  Illustrate 
this  statseent,  1st  as  discuss  the  following 
"application  prohlso*  which  was  Invented  by  aa 
sons  tloe  ago  as  a  asw  benchmark  problem  far  clam- 
latloa  software  [5]s 

Clean  a  set  of  domino  stones  from  a  domino 
gams  (usually  55 .  but  any  number  will  do). 
Place  those  stones  la  a  distance  *d*  from 
each  other.  If  now  the  first  of  these 
stones  is  pushed,  all  stones  fall  flat. 

The  question  to  be  answered  la,  at  which 
distance  "d*  between  two  ooaoaewtlva 
stones  the  chain  velocity  la  maximised. 

This  problem  la,  am  X  hope,  of  a  sufficiently 
"green  grass*  nature  te  refresh  even  the  heart  of 
a  nath  email  clan.  However,  the  problem  la  by  no 
moans  aeadamleal  as  precisely  the  same  simulation 
problem  arises  in  many  "practical*  applications, 
o.g.  the  heating  of  steel  ingots  la  a  steal 
soaking  pit  and  slabbing  mill,  or  chemical  batch 
reactions  with  charging  and  discharging  of  batch 
reactors,  or  the  traffic  flow  around  an 
Intersection  where  each  ear  may  be  modelled  by  a 
set  of  (discontinuous)  ODI'a  whereby  new  ears  may 
enter  the  conaidercd  area  at  any  Una  while  old 
oars  disappear  from  the  region  after  they  stayed 
In  the  system  for  seme  tins. 

Nhat  is  common  to  all  those  appllcaUonaT  Ob¬ 
viously,  whenever  a  discontinuity  arises,  the  in¬ 
ti  re  structure  of  the  problem  may  change,  and  evoa 
the  number  of  OCX's  is  varying  with  urns.  He  call 
these  problems  "variable  structure  problems",  laoh 
domino  stone  in  the  above  presented  problem  has  to 
obey  Newton's  law,  that  is.  Is  represented  by  a 
second  order  system  or  by  a  sot  of  two  first  order 
ODC'a.  Taking  the  53  stones  or  the  game,  we  obtain 
altogether  a  110th  order  model.  However,  It  naked 
little  sense  to  program  the  model  in  this  way  as 
only  a  very  small  number  of  atonea  are  moving 
simultaneously.  Seme  atonea  may  have  fallen  al¬ 
ready  down  while  others  are  still  untouched.  Hero- 
over,  the  physical  law,  governing  the  motion  of 
any  stone  m  the  system,  is  the  same.  It,  there¬ 
fore,  makes  such  aoro  sense  to  code  an  snuty  to 
represent  any  "model*  atone  (wo  could  talk  of  a 
"stone  typo"),  and  allow  new  stones  of  the  pre¬ 
scribed  type  to  bo  generated  at  event  tinoa  while 
others  may  he  destroyed  et  event  times.  It  la 
evident  that  there  shall  eslst  a  (possibly  oven 
oontinuous)  interaction  between  falling  stones 
which  has  to  bo  takes  Into  account.  lay  QOS 
solver,  an  they  are  currently  marketed,  la 
Unarm Uemlly  able  to  handle  thin  al  two  ties  aa 


long  aa  the  code  provides  for  appropriate  die- 
continuity  handling  mechanisms  la  the  previously 
discussed  aense.  However,  the  portion  of  the  pro¬ 
gram  which  r«atns  to  be  user  coded  will  still  bo 
substantial.  He  feel  that,  again,  the  user  should 
be  relieved  of  that  part  of  the  coding  which  la 
oomrnoa  to  all  the  shove  mentioned  examples.  Soft¬ 
ware  for  thlo  typo  of  applications  (that  1st 
variable  structure  simulation)  la  currently  under 
development  at  our  group,  but  it  la  not  yet 
finalised.  This  software  shall  consist  of  a 
FORTRIH  ooded  subroutine  package  SUP-IX  (SO),  an 
oxtonaloa  to  the  existing  package  SASP-9  [4,5,0, 
together  with  a  FISCAL  coded  preprocessor  (frame 
end)  COST  [5,7,1]  to  make  the  user  interface  a 
little  more  convenient  and  loss  error  prone. 


J.  SPARS!  LIMAN  STSTDt  SOLVES 


Looking  into  the  history  of  OXAN-codes,  the 
original  code  proposed  by  1111  Osar  himself  suf¬ 
fered  from  numerically  "dirty*  programming,  la 
Uat  It  happened  frequently  during  the  execution 
of  a  problem  that  the  program  suddenly  died  duo  to 
division  by  aoro  (a  problem  which  X  never  could 
ooavlnoa  ay  oomputor  to  handle  la  a  ee areal eat 
wayl)  or  dmo  to  similarly  unpleasant  of foots. 

The  next  "generation"  of  the  OEAN  node.  Imple¬ 
mented  by  Alan  Rlndaarah,  woo  ooaaldorably  better, 

la  Uati 

a)  the  code  waa  numerically  cleaned  up  —  am 
division  by  soro  occurred  thereafter,  and 

b)  the  code  executed  considerably  faster,  aa  the 
originally  used  (vary  primitive)  linear  system 
solver  was  replaced  by  a  far  superior  code. 

Xn  particular,  this  latter  improvement  and  the 
oonvenlent  availability  of  the  code  mode  this  Im¬ 
plementation  very  famous  and  widely  used.  (In 
fact.  It  is  still  widely  used.) 

Meanwhile,  this  second  implementation  has  soon  (at 
least)  two  auooossors,  namely  the  previously 
mentioned  implementations  by  Mike  Carver  ()]  and 
the  Implementation  by  Dave  Eahaner  [1SJ.  Although 
X  like  the  Eahaner  Implementation  boot  (for 
reasons  of  programming  cleanness)  the  Carvsr  im¬ 
plementation  enjoys  aa  important  munorioal  ad¬ 
vantage. 

Namambor  that  the  tlndmarsh  inplameatatloa 
basically  differed  free  the  original  one  in  that 
the  linear  system  solver  hod  boon  replaced,  that 
la,  that  portion  of  the  oodo  hod  boon  replaced  la 
which  most  of  the  computation  time  olapaoa. 
Nika  Carver  again  modified  this  portion  of  tha 
program  In  that  now,  la  addition  to  the  formerly 
used  linear  system  solver,  also  a  verolea 

la  available  making  use  of  the  Hold  sparse  matrix 
routines  (19).  Tbs  user  nay  decide  (through  aa  ad¬ 
ditional  awlteb)  whether  ho  wants  to  usa  tha 
spa roe  vereloa  of  the  linear  system  salvor  ar 
whether  he  vasts  te  stay  with  the  emmeanilail 
solver. 


Mum,  fir  lutMM,  the  MUtt  aquatics  (9) 
Mti  n  i«dUMMUr  hm«I  IlNriUuUH  p«IMI 
(•  mU«  which  la  hr  the  way  Ml  Miff  —  the 
stiff  algaritba  within  the  Cftf  cede  Sana  a  ter¬ 
rible  Job  aa  thla  aat  af  M  QM'al ) ,  we  bare  aa»> 
pared  tha  uaaa  algoriths  (with la  tha  QW  cede) 
aaaa  walag  a  paraa  aatrlx  teehaiquae  ah*  aaaa  ula| 
tha  eenveatlenal  algerltha.  Tha  a  paraa  version  aa* 
h»  a  raster  af  3  faatar  thaa  tha  aeaweatleaal 
waiaa.  (Thla  preblaa  was  trie*  aat  hr  aaa  af  tha 
fOUthR  aaftwara  (32.) 

Stellar  results  aaa  be  reproduced  fraa  alaaat  nag 
esaaple  (be  it  stiff  or  non-ntlff) ,  aa  aaaa  aa  a 
Wt  la  Involved,  or  *v  soon  as  the  ardor  of  tha 
ar at aa  la  larger  than  about  20 .  (la  aoat  publica¬ 
tions,  a  break  evaa  point  of  about  as 90  aaa  ho 
found,  but  thla  figure  la  derived  prlaarllr  fraa 
storage  allocation  considerations  —  a  preblaa 
uhi oh  la  getting  leaa  laportaat  with  tha  advent  a f 
aadarn  virtual  aaaary  srataaa.  It  la  aaa  tha  aaa- 
outiaa  uaa  uhiah  plays  tha  key  rale,  and,  harat 
sparse  aatria  aalutlaaa  baaaaa  attraatlva  aaaa  at 
lower  ardors.) 

This  lapravaaiat  la  fairly  aaay  to  aahilvi,  and  It 
la,  therefore,  surprising  ta  as  that  aaat  of  tha 
avail  able  aadaa  da  lasers  thla  peaalbllity.  Wa 
la  praoaaahlr  Ht  way  ta  gala  afflalaaay  utth  vary 
little  after ti  No  weald  strongly  raaaaaaad  ta  tha 
lanilaaaa  group  that  they  should  iiaatdar  thla  te 
provaaaat  far  tbatr  aaat  rot aaaa. 


t.  AOTOUTB  nmnogsag 


It  la  suite  aaaaso  ta  aaay  appllaatleaa  (a.g.  la 
ohaaiaal  aaglaaarlag)  that  aaaa  portlaaa  af  tha 
aadel  are  considerably  faster  that  ethers  (a.g.  a 
ohaaiaal ly  roaoti^  ayataa  aaaalatlag  af  test  aad 
of  alow  reactions).  It  as ana  intriguing  ta  try  ta 
reduce  the  overhead  Involved  la  tha  auaerloal 
integration  af  tha  alow  subayataa  by  splitting  tha 
ayataa  Into  a  fast  aad  lata  a  alow  portion  aad  by 
using  different  atop  alaaa  (and  poaalbly  even  dif¬ 
ferent  algor 1 thaa)  for  tha  two  of  thaa  [1TJ.  Thla 
works  suite  well  for  aaaa  appllaatleaa,  a.g.  ter 
aolftualag  regulators  with  a  (teat)  Inner  leap  aad 
a  ( considerably  slower)  outer  adaptation  loop.  (Vo 
triad  this  out  by  uaa  of  tha  SIMOOM  aaftwara 
(11,122.) 

However,  thla  partitioning  a chaos  la  net  always 
anally  dona.  It  requires  quite  aaaa  axpartaaaa  ta 
•aaa ter*  aueh  places  of  aaftwara.  Moreover,  it  la 
act  guaranteed  that  swob  a  partitioning  aoheao 
even  ealsta  ter  a  particular  atlff  ayataa.  la 
fact,  if  the  ayataa  la  nonlinear,  tha  eigenvalues 
af  the  Jacobian  any  wove  around  with  Uaa  freely, 
aad  it  any  well  happen  that  soae  nodes  of  tha 
ayataa  are  "fast*  during  seas  period  of  tins, 
while  they  are  "slew*  during  ether  periods.  Again, 
It  waa  Mika  Carver  who  ewe  up  with  a  brllUaat 
(because  entraaely  Maple)  idea  for  autcaatsd  par¬ 
titioning  which  ha  presented  in  i960  during  aa 
International  Conference  on  Slaul a tl on  bald  at 
Interlaken,  Suit a or land  [2],  His  aethod  requires 
aaa  single  additional  par  wo  tor  ta  be  user  tuned, 
a  Parana  ter  uhiah  even  baa  aaaa  physical  aeanlag 


assigned  to  It,  which  asks a  tha  adjustaaat 
re aaa nobly  aaay  oven  for  engineers,  be? Ida  fron 
thla  par  ms  tar,  tha  partitioning  la  fully  aut»> 
aatod  aad  avaa  adaptive,  la  that  It  any  vary  with 
Uaa. 


Obviously,  tha  last  ward  la  aat  pat  aald  about 
aa  las  I  ad  partitioning,  but  the  approach  takes  bp 
Carver  la  daflnttely  a  goad  atop  forward  aad  shows 
where  future  rasa arch  aaa  still  be  Soae. 
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